-- Logs begin at Tue 2022-05-24 14:49:58 UTC, end at Tue 2022-05-24 16:00:12 UTC. -- May 24 15:29:00.923075 dv-cinder-843153-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 15:29:00.933427 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 15:29:00 2022] *** May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: nodename: dv-cinder-843153-1-iscsi May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: machine: x86_64 May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: clock source: unix May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: pcre jit disabled May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: detected number of CPU cores: 4 May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: current working directory: / May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: detected binary path: /usr/bin/uwsgi-core May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: your processes number limit is 47680 May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: your memory page size is 4096 bytes May 24 15:29:00.934637 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: detected max file descriptor number: 2048 May 24 15:29:00.935392 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: lock engine: pthread robust mutexes May 24 15:29:00.935392 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: thunder lock: enabled May 24 15:29:00.935392 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 15:29:00.935392 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 15:29:00.979266 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: Python main interpreter initialized at 0x561ba17789c0 May 24 15:29:00.979266 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: python threads support enabled May 24 15:29:00.979266 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: your server socket listen backlog is limited to 100 connections May 24 15:29:00.979266 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: your mercy for graceful operations on workers is 90 seconds May 24 15:29:00.979636 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: mapped 403077 bytes (393 KB) for 2 cores May 24 15:29:00.979636 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: *** Operational MODE: preforking *** May 24 15:29:00.979922 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: *** uWSGI is running in multiple interpreter mode *** May 24 15:29:00.979922 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: spawned uWSGI master process (pid: 103336) May 24 15:29:00.980143 dv-cinder-843153-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 15:29:00.981150 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: spawned uWSGI worker 1 (pid: 103337, cores: 1) May 24 15:29:00.981150 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: spawned uWSGI worker 2 (pid: 103338, cores: 1) May 24 15:29:00.981150 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 15:29:02.120279 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 15:29:02.121113 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 15:29:02.829221 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:29:02.829221 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: from cryptography.utils import int_from_bytes May 24 15:29:02.829551 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:29:02.829551 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: from cryptography.utils import int_from_bytes May 24 15:29:02.832169 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:29:02.832169 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: from cryptography.utils import int_from_bytes May 24 15:29:02.832490 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:29:02.832490 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: from cryptography.utils import int_from_bytes May 24 15:29:05.349618 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 15:29:05.350217 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 15:29:05.350386 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 15:29:05.350727 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 15:29:05.350976 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 15:29:05.351119 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 15:29:05.351530 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.351620 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 15:29:05.351695 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.351870 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 15:29:05.351970 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.352277 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 15:29:05.352436 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.352525 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 15:29:05.352612 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.352895 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.353032 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.353172 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.353325 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.353530 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.353693 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.353876 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.353973 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.354187 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.354270 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.354465 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.354611 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.354699 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843153-1-iscsi {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.354913 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.355046 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.355205 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.355313 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.355556 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.355706 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.355803 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.355890 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.356125 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.356229 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.356447 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843153-1-iscsi {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.356552 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.356765 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.356860 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.357071 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.357275 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.357381 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.358456 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.358623 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.358738 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.358853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.358853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.359010 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.359010 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.359238 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.359238 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.359391 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.359533 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.359668 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.359809 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.359893 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.360045 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.360169 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.360270 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.360355 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.360485 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.360568 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.360766 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843153-1-iscsi {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.360858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.361082 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.361189 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.361402 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.361535 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.361702 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.361793 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.362071 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.362160 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.362386 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.362524 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843153-1-iscsi {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.362688 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.362787 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.362986 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.363088 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.363302 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.363439 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.363615 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.363716 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.363934 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.364047 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.364268 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.364371 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.364578 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.364678 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.364890 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.364986 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.365182 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.365278 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.365484 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.365596 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.365783 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.365879 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.366095 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.366184 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.366387 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.366488 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.366684 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.366780 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.366925 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.367014 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.367232 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.367328 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.367546 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.367642 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.367857 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.367947 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.368173 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.368276 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.368418 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.368515 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.368661 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.368747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.368971 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.369137 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.369352 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.369456 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.369656 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.369882 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.369970 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.370136 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.370274 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.370385 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.370531 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.370703 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.370828 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.371022 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.371119 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.371330 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.371432 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.371633 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.371725 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.371939 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.372063 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.372269 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.372368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.372574 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.372666 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.372878 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.372968 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.373180 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.373274 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.373486 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.373592 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.373797 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.373882 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.374098 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.374183 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.374417 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.374502 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.374728 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.374851 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.375027 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.375113 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.375338 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.375439 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.375658 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.375743 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.375951 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.376068 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.376275 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.376363 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.376579 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.376664 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.376891 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.376976 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.377211 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.377296 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.377510 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.377603 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.377756 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.377842 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.378051 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.378143 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.378349 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.378443 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.378662 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.378759 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.378961 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.379052 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.379260 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.379430 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.379513 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.379590 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.379817 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.379914 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.380143 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.380246 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.380444 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.380537 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.380745 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.380839 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.381044 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.381136 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.381341 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.381431 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.381637 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.381720 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.381934 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.382024 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.382232 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.382317 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.382530 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.382622 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.382831 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.382925 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.383135 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.383219 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.383430 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.383536 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.383731 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.383839 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.384042 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.384142 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.384348 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.384438 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.384687 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.384789 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.384986 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.385084 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.385287 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.385374 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.385588 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.385672 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.385887 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.385970 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.386185 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.386271 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.386496 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.386592 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.386796 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.386889 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.387097 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.387189 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.387404 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.387500 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.387696 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.387788 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.387995 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.388112 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.388334 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.388420 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.388631 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.388720 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.388933 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.389032 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.389228 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.389318 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.389523 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.389608 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.389818 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.389911 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.390113 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.390205 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.390406 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.390490 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.390712 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.390831 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.390989 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.391079 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.391287 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.391377 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.391586 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.391685 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.391884 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.391968 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.392206 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.392309 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.392502 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.392587 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.392795 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.392885 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.393110 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.393197 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.393428 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.393514 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.393745 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.393885 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.394034 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.394119 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.394334 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.394419 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.394648 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:29:05.394741 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.394973 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.395092 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.395279 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.395366 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.395586 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.395678 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.395905 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.395999 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.396234 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.396329 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.396539 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.396623 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.396848 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.396942 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.397160 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.397244 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.397472 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.397557 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.397795 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.397888 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.398103 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.398234 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.398411 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.398516 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.398718 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.398813 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.399022 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.399121 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.399332 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.399419 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.399651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.399814 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.399964 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.400099 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.400342 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.400495 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.400667 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.400765 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.400976 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.401062 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.401291 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.401376 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.401604 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.401700 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.401915 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.402007 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.402220 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.402310 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.402525 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.402616 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.402829 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.402914 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.403140 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.403226 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.403464 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.403550 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.403767 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.403851 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.404101 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.404192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.404410 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.404495 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.404712 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.404797 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.405017 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.405116 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.405320 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.405409 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.405624 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.405718 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.405933 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.406026 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.406241 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.406327 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.406546 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.406640 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.406849 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.406942 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.407157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.407250 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.407459 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.407543 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.407764 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.407863 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.408091 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.408180 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.408390 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.408475 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.408689 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.408776 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.408986 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.409070 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.409287 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.409371 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.409583 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.409675 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.409892 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.409977 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.410191 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.410283 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.410804 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.410909 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.411105 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.411190 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.411407 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.411499 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.411713 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.411862 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.412004 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.412167 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.412329 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.412414 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.412626 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.412712 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.412934 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.413030 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.413239 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.413337 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.413533 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.413618 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.413839 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.413924 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.414140 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.414281 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.414423 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.414565 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.414732 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.414865 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.415012 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.415154 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.415309 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.415438 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.415612 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.415762 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.415959 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.416147 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.416277 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.416419 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.416583 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.416722 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.416883 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.417024 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.417184 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.417327 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.417489 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.417639 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.417784 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.417914 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.418084 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.418219 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.418391 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.418533 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.418683 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.418815 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.419001 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.419140 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.419312 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.419462 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.419603 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.419734 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.419899 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.420051 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.420224 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.420363 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.420522 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.420656 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.420823 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.420952 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.421117 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.421217 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.421417 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.421504 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.421711 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.421795 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.422005 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.422100 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.422301 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.422394 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.422596 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.422695 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.422894 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.422991 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.423206 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.423308 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.423501 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.423591 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.423797 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.423886 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.424112 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.424212 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.424407 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.424504 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.424703 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.424798 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.425018 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.425110 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.425337 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.425421 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.425625 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.425723 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.425922 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.426006 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.426220 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.426304 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.426549 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.426635 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.426847 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.426930 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.427155 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.427247 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.427458 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.427544 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.427760 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.427851 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.428081 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.428251 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.428395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.428479 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.428695 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.428787 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.429007 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.429100 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.429311 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.429394 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.429622 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.429715 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.429923 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.430015 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.430234 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.430325 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.430530 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.430621 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.430841 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.430987 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.431144 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.431285 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.431465 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.431628 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.431840 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.431968 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.432178 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.432343 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.432481 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.432662 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.432807 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.432968 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.433108 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.433307 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.433462 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.433640 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.433782 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.433939 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.434089 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.434250 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.434378 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.434553 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.434695 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.434859 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.435000 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.435160 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.435300 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.435472 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.435600 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.435756 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.435886 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.436081 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.436215 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.436380 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.436519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.436686 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.436772 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.436995 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.437078 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.437304 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.437389 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.437606 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.437689 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.437909 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.438001 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.438221 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.438306 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.438523 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.438606 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.438823 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.438917 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.439126 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.439211 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.439422 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.439515 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.439721 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.439815 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.440023 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.440137 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.440355 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.440448 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.440656 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.440750 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.440956 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.441040 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.441251 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.441335 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.441552 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.441648 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.441849 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.441942 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.442144 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.442235 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.442437 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.442523 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.442739 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.442831 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.443042 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.443126 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.443341 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.443425 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.443647 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.443731 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.443952 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.444064 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.444272 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.444404 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.444569 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.444653 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.444876 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.444961 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.445175 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.445268 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.445471 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.445556 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.445766 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.445867 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.446061 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.446147 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.446373 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.446457 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.446672 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.446765 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.446970 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.447054 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.447321 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.447414 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.447635 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.447734 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.447936 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.448057 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.448261 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.448364 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.448562 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.448656 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.448863 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.448955 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.449174 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.449265 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.449477 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.449562 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.449778 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.449864 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.450082 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.450167 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.450385 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.450477 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.450686 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.450781 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.450987 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.451107 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.451298 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.451383 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.451597 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.451682 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.451900 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.451986 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.452223 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.452331 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.452520 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.452605 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.452822 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.452916 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.453126 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.453210 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.453444 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.453679 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.453782 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.454007 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.454097 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.454312 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.454437 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.454619 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.454704 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.454926 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.455021 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.455233 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.455317 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.455552 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.455791 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.455889 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.456147 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.456247 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.456465 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.456560 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.456783 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.456868 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.457081 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.457174 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.457378 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.457463 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.457680 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.457764 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.457978 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.458063 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.458273 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.458358 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.458570 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.458664 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.458871 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.458964 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.459168 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.459253 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.459462 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.459546 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.459757 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.459843 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.460070 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.460156 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.460380 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.460466 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.460677 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.460762 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.460982 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.461076 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.461279 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.461427 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.461565 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.461701 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.461861 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.461991 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.462163 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.462294 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.462455 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.462589 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.462767 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.462866 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.463116 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.463248 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.463414 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.463543 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.463732 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.463860 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.464049 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.464192 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.464366 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.464495 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.464670 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.464811 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.464968 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.465113 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.465288 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.465431 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.465586 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.465719 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.465891 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.466038 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.466179 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.466312 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.466478 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.466632 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.466774 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.466904 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.467070 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.467203 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.467374 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.467513 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.467662 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.467794 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.467961 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.468119 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.468286 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.468415 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.468569 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.468704 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.468870 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.469004 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.469165 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.469293 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.469471 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.469604 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.469773 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.469901 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.470068 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.470214 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.470347 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.470489 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.470650 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.470784 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.470953 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.471095 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.471235 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.471370 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.471536 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.471622 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.471832 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.471926 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.472151 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.472241 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.472450 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.472535 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.472746 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.472843 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.473040 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.473137 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.473336 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.473431 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.473634 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.473720 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.473929 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.474024 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.474239 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.474326 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.474536 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.474628 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.474831 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.474919 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.475126 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.475210 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.475425 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.475510 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.475720 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.475814 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.476015 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.476167 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.476335 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.476420 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.476641 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.476726 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.476941 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.477040 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.477236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.477319 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.477535 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.477620 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.477829 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.477928 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.478125 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.478210 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.478443 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.478532 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.478769 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.478872 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.479135 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.479234 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.479354 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.479441 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.479647 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.479786 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.479941 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.480070 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.480261 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.480347 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.480561 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.480647 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.480864 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.480948 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.481160 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.481244 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.481453 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.481539 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.481746 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.481832 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.482042 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.482133 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.482343 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.482428 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.482659 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.482744 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.482963 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.483048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.483263 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.483356 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.483562 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.483647 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.483862 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.483956 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.484185 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.484271 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.484490 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.484577 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.484789 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.484888 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.485097 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.485183 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.485400 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.485486 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.485705 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.485807 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.486001 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.486086 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.486295 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.486380 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.486609 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.486772 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.486908 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.486993 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.487208 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.487291 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.487509 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.487610 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.487816 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.487905 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.488139 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.488242 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.488439 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.488526 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.488740 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.488824 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.489045 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.489137 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.489346 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.489443 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.489646 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.489743 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.489947 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.490033 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.490249 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.490335 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.490549 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.490643 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.490852 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.490939 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.491152 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.491237 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.491452 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.491545 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.491749 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.491842 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.492070 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.492157 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.492374 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.492466 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.492668 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.492763 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.492974 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.493059 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.493276 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.493359 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.493573 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.493733 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.493872 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.493957 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.494250 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.494334 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.494509 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.494605 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.494804 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.494944 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.495134 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.495221 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.495442 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.495529 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.495745 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.495829 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.496069 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.496169 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.496374 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.496467 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.496682 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.496767 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.496980 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.497065 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.497286 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.497401 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.497582 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.497713 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.497994 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.498133 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.498296 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.498424 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.498588 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.498721 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.498889 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.499031 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.499185 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.499318 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.499478 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.499623 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.499780 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.499921 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.500117 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.500264 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.500405 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.500538 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.500681 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.500822 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.500979 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.501116 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.501294 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.501440 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.501574 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.501719 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.501889 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.502018 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.502269 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.502398 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.502571 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.502709 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.502867 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.502995 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.503164 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.503299 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.503482 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.503620 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.503782 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.503919 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.504107 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.504249 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.504473 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.504606 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.504789 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.504920 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.505087 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.505229 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.505393 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.505543 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.505681 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.505813 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.506000 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.506142 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.506315 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.506414 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.506619 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.506706 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.506924 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.507010 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.507219 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.507319 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.507536 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.507623 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.507848 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.507969 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.508174 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.508270 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.508487 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.508581 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.508793 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.508878 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.509108 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.509202 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.509413 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.509499 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.509764 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.509860 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.510083 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.510183 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.510401 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.510493 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.510696 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.510803 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.510998 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.511215 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.511301 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.511536 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.511630 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.511842 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.511979 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.512189 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.512277 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.512496 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.512580 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.512801 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.512899 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.513098 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.513183 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.513391 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.513474 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.513690 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.513789 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.513989 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.514075 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.514287 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.514370 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.514591 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.514677 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.514895 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.514980 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.515188 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.515273 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.515486 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.515579 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.515784 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.515869 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.516102 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.516200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.516407 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.516550 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.516707 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.516839 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.517001 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.517137 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.517292 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.517426 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.517605 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.517740 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.517882 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.518033 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.518197 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.518327 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.518513 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.518643 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.518818 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.518956 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.519118 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.519257 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.519419 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.519556 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.519718 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.519856 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.520066 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.520198 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.520346 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.520486 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.520666 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.520813 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.520945 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.521078 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.521243 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.521376 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.521545 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.521678 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.521845 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.521963 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.522140 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.522229 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.522434 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.522528 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.522734 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.522819 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.523026 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.523111 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.523319 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.523405 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.523610 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.523702 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.523925 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.524010 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.524243 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.524337 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.524555 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.524647 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.524857 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.524970 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.525154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.525251 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.525495 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.525608 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.525869 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.525963 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.526202 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.526286 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.526501 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.526596 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.526807 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.526901 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.527124 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.527209 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.527430 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.527514 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.527730 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.527838 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.528056 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.528142 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.528350 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.528460 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.528664 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.528750 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.528970 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.529054 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.529280 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.529363 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.529587 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.529674 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.529895 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.529986 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.530203 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.530287 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.530508 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.530601 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.530808 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.530891 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.531114 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.531197 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.531421 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.531506 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.531729 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.531839 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.532054 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.532262 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.532442 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.532585 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.532759 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.532919 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.533063 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.533214 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.533367 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.533502 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.533681 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.533814 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.533992 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.534139 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.534306 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.534435 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.534653 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.534821 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.534955 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.535149 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.535603 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.535775 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.535912 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.536109 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.536253 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.536421 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.536563 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.536732 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.536862 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.537040 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.537183 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.537352 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.537487 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.537661 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.537795 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.537970 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.538104 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.538279 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.538409 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.538604 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.538736 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.538920 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.539061 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.539227 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.539362 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.539532 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.539666 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.539875 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.540008 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.540192 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.540326 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.540458 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.540612 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.540745 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.540894 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.541144 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.541281 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.541456 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.541603 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.541762 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.541896 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.542105 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.542240 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.542380 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.542510 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.542662 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.542791 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.542969 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.543107 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.543273 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.543415 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.543577 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.543709 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.543881 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.544014 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.544209 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.544343 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.544513 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.544717 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.544862 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.545025 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.545169 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.545348 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.545481 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.545666 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.545800 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.545983 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.546119 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.546291 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.546425 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.546606 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.546739 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.546903 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.546985 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.547213 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.547414 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.547499 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.547723 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.547822 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.548068 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.548157 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.548394 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.548479 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.548709 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.548803 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.549011 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.549104 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.549308 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.549393 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.549619 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.549705 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.549920 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.550013 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.550219 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.550443 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.550542 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.550788 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.550874 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.551101 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.551185 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.551420 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.551513 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.551725 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.551811 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.552023 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.552169 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.552346 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.552433 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.552651 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.552736 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.552954 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.553175 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.553271 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.553514 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.553600 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.553825 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.553910 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.554122 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.554216 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.554418 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.554540 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.554724 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.554812 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.555027 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.555113 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.555323 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.555408 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.555626 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.555713 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.555922 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.556008 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.556260 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.556345 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.556663 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.556840 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.556959 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.557055 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.557206 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.557386 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.557513 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.557700 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.557818 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.558004 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.558118 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.558305 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.558423 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.558606 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.558723 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.558903 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.559046 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.559210 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.559353 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.559507 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.559655 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.559810 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.559954 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.560131 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.560286 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.560437 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.560585 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.560732 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.560884 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.561033 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.561183 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.561377 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.561465 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.561699 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.561785 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.561996 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.562082 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.562292 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.562379 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.562600 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.562685 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.562901 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.562996 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.563209 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.563294 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.563513 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.563598 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.563812 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.563910 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.564185 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.564274 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.564485 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.564570 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.564783 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.565057 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.565152 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.565382 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.565467 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.565694 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.565782 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.565998 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.566090 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.566302 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.566388 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.566617 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.566711 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.566915 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.567000 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.567214 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.567458 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.567550 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.567791 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.567889 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.568134 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.568236 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.568438 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.568523 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.568740 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.568826 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.569045 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.569130 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.569347 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.569445 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.569647 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.569740 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.569949 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.570035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.570252 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.570346 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.570553 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.570638 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.570858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.570942 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.571158 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.571250 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.571460 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.571544 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.571765 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.571850 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.572113 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.572488 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.572572 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.572651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.572729 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.572888 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.573010 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.573201 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.573314 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.573509 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.573618 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.573816 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.573930 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.574121 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.574267 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.574426 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.574584 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.574737 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.574899 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.575060 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.575210 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.575367 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.575522 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.575685 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.575828 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.576081 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.576171 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.576392 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.576477 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.576705 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.576792 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.577020 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.577106 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.577323 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.577409 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.577637 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.577723 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.577938 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.578030 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.578238 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.578336 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.578551 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.578636 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.578853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.578938 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.579172 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.579266 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.579500 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.579585 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.579818 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.579912 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.580162 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.580263 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.580460 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.580545 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.580758 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.580843 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.581055 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.581141 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.581357 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.581443 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.581670 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.581755 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.581971 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.582057 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.582269 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.582354 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.582564 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.582668 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.582865 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.582952 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.583160 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.583246 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.583452 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.583546 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.583745 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.583830 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.584069 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.584158 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.584356 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.584454 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.584646 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.584731 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.584940 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.585033 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.585233 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.585327 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.585527 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.585612 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.585823 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.585907 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.586114 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.586211 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.586414 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.586542 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.586709 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.586820 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.587002 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.587128 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.587296 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.587389 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.587591 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.587682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.587959 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.588068 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.588356 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.588443 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.588663 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.588785 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.588967 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.589057 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.589273 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.589361 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.589572 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.589665 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.589874 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.589961 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.590171 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.590257 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.590499 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.590594 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.590811 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.590915 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.591117 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.591215 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.591416 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.591511 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.591726 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.591811 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.592048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.592148 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.592358 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.592460 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.592663 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.592758 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.592966 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.593053 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.593267 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.593363 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.593567 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.593654 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.593886 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.593971 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.594191 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.594276 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.594486 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.594570 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.594790 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.594874 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.595099 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.595186 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.595406 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.595492 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.595711 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.595796 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.596012 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.596114 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.596350 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.596437 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.596652 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.596748 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.596956 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.597048 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.597264 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.597358 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.597564 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.597665 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.597865 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.597952 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.598171 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.598257 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.598521 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.598617 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.598843 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.598980 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.599159 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.599245 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.599462 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.599549 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.599821 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.599914 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.600102 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.600205 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.600418 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.600512 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.600731 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.600819 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.601053 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.601138 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.601375 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.601468 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.601679 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.601771 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.601981 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.602065 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.602280 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.602373 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.602518 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 15:29:05.602640 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.602950 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.603287 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.603753 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.604098 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.604411 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.604715 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:29:05.604958 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 15:29:05.659930 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Registered counter for database nova_api May 24 15:29:05.663058 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO dbcounter [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Registered counter for database nova_api May 24 15:29:05.680702 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:29:05.683008 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG oslo_db.sqlalchemy.engines [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:29:05.687414 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:29:05.693872 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writer thread running {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:29:05.743627 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.context [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),524ab7f1-ba78-4fd5-b69d-b9e525298061(cell1) {{(pid=103337) load_cells /opt/stack/nova/nova/context.py:464}} May 24 15:29:05.747801 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:05.749398 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:05.750165 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:05.750691 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.context [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),524ab7f1-ba78-4fd5-b69d-b9e525298061(cell1) {{(pid=103338) load_cells /opt/stack/nova/nova/context.py:464}} May 24 15:29:05.752133 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:05.754102 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Registered counter for database nova_cell0 May 24 15:29:05.754783 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG oslo_concurrency.lockutils [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:05.756358 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG oslo_concurrency.lockutils [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:05.757130 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG oslo_concurrency.lockutils [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:29:05.758020 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Registered counter for database nova_cell1 May 24 15:29:05.759077 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG oslo_concurrency.lockutils [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:29:05.761333 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO dbcounter [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Registered counter for database nova_cell0 May 24 15:29:05.765309 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:29:05.765580 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO dbcounter [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Registered counter for database nova_cell1 May 24 15:29:05.766445 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:29:05.772502 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:29:05.772753 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG oslo_db.sqlalchemy.engines [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:29:05.774911 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:29:05.775792 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG oslo_db.sqlalchemy.engines [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:29:05.779247 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writer thread running {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:29:05.914819 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writer thread running {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:29:05.917074 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Registered counter for database nova_cell0 May 24 15:29:05.924442 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:29:05.924828 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO dbcounter [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Registered counter for database nova_cell0 May 24 15:29:05.928946 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:29:05.933910 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG oslo_db.sqlalchemy.engines [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:29:05.938597 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writer thread running {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:29:06.258040 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: WARNING keystonemiddleware.auth_token [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:29:06.259236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:29:06.265234 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: WARNING keystonemiddleware.auth_token [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:29:06.266387 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:29:06.604788 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:29:06.610612 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:29:06.615809 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ba17789c0 pid: 103337 (default app) May 24 15:29:06.615941 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: WARNING keystonemiddleware.auth_token [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:29:06.617887 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:29:06.619116 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 May 24 15:29:06.619596 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Tue May 24 15:29:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:29:06.621914 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: WARNING keystonemiddleware.auth_token [None req-2f7535be-0abc-411a-801e-f51bf5c5e0eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:29:06.627150 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ba17789c0 pid: 103338 (default app) May 24 15:30:25.256498 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:25.258347 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002553 May 24 15:30:25.259469 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:25.272196 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_api:SELECT=3 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:25.273410 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_cell0:SELECT=3 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:25.274238 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_cell1:SELECT=3 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:25.275371 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:25.715253 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-d5f1e53c-6778-4476-9c52-df9bd2df82fa admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:25.745008 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-d5f1e53c-6778-4476-9c52-df9bd2df82fa admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.478099 May 24 15:30:25.745686 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 24 15:30:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:30:27.993243 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:27.994296 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c6e8025e-776d-4bc5-a09b-b975938e1646 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 24 15:30:27.994682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 3/4] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:28.060687 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-099e4bef-fb29-4883-b6ff-4a06579098e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "name": "cirros256", "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:28.079588 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:30:28.079588 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: warnings.warn(msg) May 24 15:30:28.108261 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-099e4bef-fb29-4883-b6ff-4a06579098e2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107477 May 24 15:30:28.108795 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 2/5] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 24 15:30:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:30:28.123126 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:28.124404 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell0:SELECT=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:28.125443 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell1:SELECT=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:28.126376 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:30:28.337514 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-400abd78-bcba-48f3-a4e9-843de6a040c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:28.340215 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:30:28.340215 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: warnings.warn(msg) May 24 15:30:28.410974 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-400abd78-bcba-48f3-a4e9-843de6a040c5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293699 May 24 15:30:28.411844 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 4/6] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 24 15:30:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:30:30.660948 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-099e4bef-fb29-4883-b6ff-4a06579098e2 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:30.662007 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-099e4bef-fb29-4883-b6ff-4a06579098e2 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 May 24 15:30:30.662356 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 3/7] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:30.793043 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-d31b9c6e-bae7-4430-bd99-7be220decbd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "name": "ds512M", "disk": 5, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:30.810794 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:30:30.810794 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: warnings.warn(msg) May 24 15:30:30.829864 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-d31b9c6e-bae7-4430-bd99-7be220decbd8 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160897 May 24 15:30:30.830420 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 5/8] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 24 15:30:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:30.842590 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-56cad325-f7a2-43ee-91c6-a0b666c1fb9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:30.844018 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:30:30.844018 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: warnings.warn(msg) May 24 15:30:30.874235 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-56cad325-f7a2-43ee-91c6-a0b666c1fb9b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035455 May 24 15:30:30.875094 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 4/9] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 24 15:30:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:30:33.198115 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-d31b9c6e-bae7-4430-bd99-7be220decbd8 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:33.199793 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-d31b9c6e-bae7-4430-bd99-7be220decbd8 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005829 May 24 15:30:33.200247 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:33 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:33.267475 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-61b88966-a5b0-4eb5-b05c-c9454d80d588 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:33.303813 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-61b88966-a5b0-4eb5-b05c-c9454d80d588 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097049 May 24 15:30:33.306451 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 5/11] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 24 15:30:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:33.323206 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-cf25e068-a13a-4a72-a3ff-3628c856ed91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:33.362991 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-cf25e068-a13a-4a72-a3ff-3628c856ed91 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046501 May 24 15:30:33.372681 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 7/12] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 24 15:30:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:30:35.626345 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-61b88966-a5b0-4eb5-b05c-c9454d80d588 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:35.627367 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-61b88966-a5b0-4eb5-b05c-c9454d80d588 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 May 24 15:30:35.628250 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 6/13] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:35.698726 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c1aaab19-27f9-457b-8a9d-4e047bd9faf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "name": "ds2G"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:35.720457 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c1aaab19-27f9-457b-8a9d-4e047bd9faf9 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084013 May 24 15:30:35.721020 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 8/14] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 24 15:30:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:35.737086 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-250253ec-0a4e-41a9-ba50-85e3b914e9dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:35.764057 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-250253ec-0a4e-41a9-ba50-85e3b914e9dc admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033898 May 24 15:30:35.764840 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 7/15] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 24 15:30:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:30:38.087131 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c1aaab19-27f9-457b-8a9d-4e047bd9faf9 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:38.095248 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c1aaab19-27f9-457b-8a9d-4e047bd9faf9 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005258 May 24 15:30:38.106132 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 9/16] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:38 2022] GET /compute/v2.1 => generated 388 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:38.184490 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-c3a3f711-a008-4073-93e3-0da20f632a0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "ram": 4096}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:38.205867 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-c3a3f711-a008-4073-93e3-0da20f632a0a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.103033 May 24 15:30:38.206979 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 8/17] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 24 15:30:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:38.219091 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-b476615a-8d0d-42cc-a36a-56b26cda9c21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:38.246808 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-b476615a-8d0d-42cc-a36a-56b26cda9c21 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031848 May 24 15:30:38.248497 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 10/18] 10.222.0.55 () {64 vars in 1335 bytes} [Tue May 24 15:30:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:30:40.498300 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-c3a3f711-a008-4073-93e3-0da20f632a0a admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:40.499924 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-c3a3f711-a008-4073-93e3-0da20f632a0a admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002018 May 24 15:30:40.500676 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 9/19] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:40.561675 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-12547008-420a-4677-ab7f-33e5a8a91d1b admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:40.585668 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-12547008-420a-4677-ab7f-33e5a8a91d1b admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079017 May 24 15:30:40.586785 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 24 15:30:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:30:42.870990 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-c3a3f711-a008-4073-93e3-0da20f632a0a admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:42.872237 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-c3a3f711-a008-4073-93e3-0da20f632a0a admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 May 24 15:30:42.872695 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 10/21] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:42.944571 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-8917d743-6e50-4925-a0aa-54186ded5291 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:42.962921 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-8917d743-6e50-4925-a0aa-54186ded5291 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083645 May 24 15:30:42.963570 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 12/22] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 24 15:30:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:42.975448 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-9ebe4fd5-33c2-413c-994a-6d0f93aa7543 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:42.998969 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-9ebe4fd5-33c2-413c-994a-6d0f93aa7543 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027150 May 24 15:30:42.999545 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 11/23] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 24 15:30:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:30:45.328425 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-8917d743-6e50-4925-a0aa-54186ded5291 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:45.329959 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-8917d743-6e50-4925-a0aa-54186ded5291 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 May 24 15:30:45.330474 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:45.392299 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4261ccfe-439e-4d47-a400-7d9073360eff admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:45.411459 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4261ccfe-439e-4d47-a400-7d9073360eff admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073141 May 24 15:30:45.412083 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 12/25] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 24 15:30:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:30:45.424510 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-6258ee4e-0017-40a7-afce-c22e0862082e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:45.452490 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-6258ee4e-0017-40a7-afce-c22e0862082e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031562 May 24 15:30:45.453275 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 14/26] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 24 15:30:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:30:47.706350 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4261ccfe-439e-4d47-a400-7d9073360eff admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:47.707397 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4261ccfe-439e-4d47-a400-7d9073360eff admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 May 24 15:30:47.707817 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 13/27] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:47.780300 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-b055b1ff-964d-45f3-bf79-fb1f80f47fd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:47.801087 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-b055b1ff-964d-45f3-bf79-fb1f80f47fd1 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.086549 May 24 15:30:47.801616 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 15/28] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 24 15:30:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:30:47.815505 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-dbae9361-67e9-4021-acd9-70f95faf8efe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:47.841145 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-dbae9361-67e9-4021-acd9-70f95faf8efe admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029791 May 24 15:30:47.841782 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 14/29] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 24 15:30:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:30:50.102951 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-b055b1ff-964d-45f3-bf79-fb1f80f47fd1 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:50.104340 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-b055b1ff-964d-45f3-bf79-fb1f80f47fd1 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001737 May 24 15:30:50.104751 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:50.163580 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-996b0ce4-690a-45a0-8918-0a5da0822878 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:50.182315 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-996b0ce4-690a-45a0-8918-0a5da0822878 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071428 May 24 15:30:50.182850 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 15/31] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 24 15:30:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:30:50.194983 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-b75c893e-2b76-4dce-a223-7a00f2de8c2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:50.221098 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-b75c893e-2b76-4dce-a223-7a00f2de8c2b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029930 May 24 15:30:50.221674 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 17/32] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 24 15:30:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:30:52.463485 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-996b0ce4-690a-45a0-8918-0a5da0822878 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:30:52.464527 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-996b0ce4-690a-45a0-8918-0a5da0822878 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 May 24 15:30:52.464925 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 16/33] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:30:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:30:52.527792 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e516b0e3-ec70-4cd5-9cf6-918a3d602fd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "ram": 16384}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:52.552607 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e516b0e3-ec70-4cd5-9cf6-918a3d602fd6 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080695 May 24 15:30:52.553437 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 18/34] 10.222.0.55 () {64 vars in 1282 bytes} [Tue May 24 15:30:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:30:52.570615 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-462f410a-772e-4e84-9aab-66ed03fbe29b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:30:52.594997 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-462f410a-772e-4e84-9aab-66ed03fbe29b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028124 May 24 15:30:52.595601 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 17/35] 10.222.0.55 () {64 vars in 1332 bytes} [Tue May 24 15:30:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:31:17.206339 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e516b0e3-ec70-4cd5-9cf6-918a3d602fd6 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:17.207342 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e516b0e3-ec70-4cd5-9cf6-918a3d602fd6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 24 15:31:17.207736 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 19/36] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:31:17.218365 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:31:17.272454 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-193179e7-d698-4fc9-8c48-e6da8cb1e86d admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:17.295534 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-193179e7-d698-4fc9-8c48-e6da8cb1e86d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.081790 May 24 15:31:17.296057 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 24 15:31:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:31:18.293712 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e516b0e3-ec70-4cd5-9cf6-918a3d602fd6 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:18.294709 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e516b0e3-ec70-4cd5-9cf6-918a3d602fd6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 24 15:31:18.295101 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 20/38] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:31:18.501387 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-681325b2-6081-4657-945e-1f02057eb413 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:18.507256 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.wsgi [None req-681325b2-6081-4657-945e-1f02057eb413 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-681325b2-6081-4657-945e-1f02057eb413 admin admin] Request method failure captured: May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Accept: application/json May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Accept-Encoding: gzip, deflate May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Connection: keep-alive May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Content-Length: 0 May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Host: 10.222.0.55 May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Openstack-Api-Version: compute 2.90 May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Openstack-System-Scope: None May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: User-Agent: python-novaclient May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Auth-Token: gAAAAABijPpGVQWy74yVxe8nOyG4vVamT_hpnYilMNYt4HxGI57ulzk14yBQAMVKF4qwNmWr9ZtsNIPGrESPoD0lD06Cg1oGWXGE1N0-pl35gVQiXinIeiearkZyFgi6L79OkII-6vVgGnUJw27iyE_mMzQavzax6TPdN7Pa2i-Hf_A9HrVrP2E May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Domain-Id: None May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Domain-Name: None May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Identity-Status: Confirmed May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Is-Admin-Project: True May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Domain-Id: default May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Domain-Name: Default May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Name: admin May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Role: reader,admin,member May 24 15:31:18.510507 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Roles: reader,admin,member May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Tenant: admin May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Tenant-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Tenant-Name: admin May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User: admin May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Domain-Id: default May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Domain-Name: Default May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Id: 108385be6e5b428a910af5b70d71b0c3 May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Name: admin May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: method: > May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: exception: Flavor 42 could not be found. May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: action_args: {'id': '42'} May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:31:18.511972 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:18.512858 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:18.513977 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-681325b2-6081-4657-945e-1f02057eb413 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:31:18.515137 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-681325b2-6081-4657-945e-1f02057eb413 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.072928 May 24 15:31:18.515137 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 19/39] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 24 15:31:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:31:18.521917 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-65ef1d56-3b75-4bae-ba14-37f28a4e74f3 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:18.524910 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:31:18.545278 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-65ef1d56-3b75-4bae-ba14-37f28a4e74f3 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026943 May 24 15:31:18.545810 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 21/40] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 24 15:31:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:31:18.555811 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-62bbaccb-fc23-4b10-8407-ac3e2e948a90 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:18.577592 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-62bbaccb-fc23-4b10-8407-ac3e2e948a90 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025343 May 24 15:31:18.578137 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 20/41] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 24 15:31:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:31:18.589806 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e1a1107b-5197-49e3-94dc-b2fade3b79b2 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:18.596200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.wsgi [None req-e1a1107b-5197-49e3-94dc-b2fade3b79b2 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e1a1107b-5197-49e3-94dc-b2fade3b79b2 admin admin] Request method failure captured: May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Accept: application/json May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Accept-Encoding: gzip, deflate May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Connection: keep-alive May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Content-Length: 0 May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Host: 10.222.0.55 May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Openstack-Api-Version: compute 2.90 May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Openstack-System-Scope: None May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: User-Agent: python-novaclient May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Auth-Token: gAAAAABijPpGVQWy74yVxe8nOyG4vVamT_hpnYilMNYt4HxGI57ulzk14yBQAMVKF4qwNmWr9ZtsNIPGrESPoD0lD06Cg1oGWXGE1N0-pl35gVQiXinIeiearkZyFgi6L79OkII-6vVgGnUJw27iyE_mMzQavzax6TPdN7Pa2i-Hf_A9HrVrP2E May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Domain-Id: None May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Domain-Name: None May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Identity-Status: Confirmed May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Is-Admin-Project: True May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Id: default May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Name: Default May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Name: admin May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Role: reader,admin,member May 24 15:31:18.599441 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Roles: reader,admin,member May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Tenant: admin May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Tenant-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Tenant-Name: admin May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User: admin May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Id: default May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Name: Default May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Id: 108385be6e5b428a910af5b70d71b0c3 May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Name: admin May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: method: > May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: exception: Flavor 42 could not be found. May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: action_args: {'id': '42'} May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:31:18.600853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:18.603395 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:18.604651 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e1a1107b-5197-49e3-94dc-b2fade3b79b2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:31:18.605853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e1a1107b-5197-49e3-94dc-b2fade3b79b2 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014803 May 24 15:31:18.605853 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 22/42] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 24 15:31:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:31:19.475493 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-62bbaccb-fc23-4b10-8407-ac3e2e948a90 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:19.477134 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-62bbaccb-fc23-4b10-8407-ac3e2e948a90 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002401 May 24 15:31:19.477735 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 21/43] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:31:19.705490 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-7c44ecd0-0f40-40b3-8697-62282835a0ca admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:19.713743 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.wsgi [None req-7c44ecd0-0f40-40b3-8697-62282835a0ca admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-7c44ecd0-0f40-40b3-8697-62282835a0ca admin admin] Request method failure captured: May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Accept: application/json May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Accept-Encoding: gzip, deflate May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Connection: keep-alive May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Content-Length: 0 May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Host: 10.222.0.55 May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Openstack-Api-Version: compute 2.90 May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Openstack-System-Scope: None May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: User-Agent: python-novaclient May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Auth-Token: gAAAAABijPpH5iy5JWUMmgpG5bFPpvauTern3Qz4dH9euJlks2CtmMVPdKGhW3xgxat6KKnQ0HhsQoGCs8zG7BmjUdb3ZD-HX29btKx6JsR5niGD0HhaWPAo_MwhkVcvn5gq8RPkvJAaSnKSRlTWoTzy1kdJjgW-8pGWOoEia2NKchWosjsn4Vo May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Domain-Id: None May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Domain-Name: None May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Identity-Status: Confirmed May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Is-Admin-Project: True May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Id: default May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Name: Default May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Name: admin May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Role: reader,admin,member May 24 15:31:19.715682 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Roles: reader,admin,member May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Tenant: admin May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Tenant-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Tenant-Name: admin May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User: admin May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Id: default May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Name: Default May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Id: 108385be6e5b428a910af5b70d71b0c3 May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Name: admin May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: method: > May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: exception: Flavor 84 could not be found. May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: action_args: {'id': '84'} May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:31:19.717154 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:19.718048 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:19.719368 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-7c44ecd0-0f40-40b3-8697-62282835a0ca admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:31:19.720604 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-7c44ecd0-0f40-40b3-8697-62282835a0ca admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.087652 May 24 15:31:19.720800 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 23/44] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 24 15:31:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:31:19.728144 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-49f56ee5-cf0b-4db4-a127-a02e06fa25a1 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:19.745060 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-49f56ee5-cf0b-4db4-a127-a02e06fa25a1 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020523 May 24 15:31:19.745618 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 22/45] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 24 15:31:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:31:19.755645 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c1e62ab7-7f85-4d74-8075-01f09202483c admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:19.770095 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c1e62ab7-7f85-4d74-8075-01f09202483c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017978 May 24 15:31:19.770640 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 24 15:31:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:31:19.780579 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-77dba6f7-f775-4033-92d6-d2993bfd903d admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:19.786640 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.wsgi [None req-77dba6f7-f775-4033-92d6-d2993bfd903d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-77dba6f7-f775-4033-92d6-d2993bfd903d admin admin] Request method failure captured: May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Accept: application/json May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Accept-Encoding: gzip, deflate May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Connection: keep-alive May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Content-Length: 0 May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Host: 10.222.0.55 May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Openstack-Api-Version: compute 2.90 May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Openstack-System-Scope: None May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: User-Agent: python-novaclient May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Auth-Token: gAAAAABijPpH5iy5JWUMmgpG5bFPpvauTern3Qz4dH9euJlks2CtmMVPdKGhW3xgxat6KKnQ0HhsQoGCs8zG7BmjUdb3ZD-HX29btKx6JsR5niGD0HhaWPAo_MwhkVcvn5gq8RPkvJAaSnKSRlTWoTzy1kdJjgW-8pGWOoEia2NKchWosjsn4Vo May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Domain-Id: None May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Domain-Name: None May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Identity-Status: Confirmed May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Is-Admin-Project: True May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Domain-Id: default May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Domain-Name: Default May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Name: admin May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Role: reader,admin,member May 24 15:31:19.788157 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Roles: reader,admin,member May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Tenant: admin May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Tenant-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Tenant-Name: admin May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User: admin May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Domain-Id: default May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Domain-Name: Default May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Id: 108385be6e5b428a910af5b70d71b0c3 May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Name: admin May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: method: > May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: exception: Flavor 84 could not be found. May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: action_args: {'id': '84'} May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:31:19.789610 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:19.790497 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:19.791519 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-77dba6f7-f775-4033-92d6-d2993bfd903d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:31:19.792578 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-77dba6f7-f775-4033-92d6-d2993bfd903d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012706 May 24 15:31:19.792578 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 23/47] 10.222.0.55 () {60 vars in 1190 bytes} [Tue May 24 15:31:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:31:20.676434 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c1e62ab7-7f85-4d74-8075-01f09202483c admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:20.677437 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c1e62ab7-7f85-4d74-8075-01f09202483c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 24 15:31:20.677825 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 25/48] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:31:20.871948 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-547e629e-e96c-45f0-9cbc-9b578803290f admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:20.878319 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.wsgi [None req-547e629e-e96c-45f0-9cbc-9b578803290f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-547e629e-e96c-45f0-9cbc-9b578803290f admin admin] Request method failure captured: May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Accept: application/json May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Accept-Encoding: gzip, deflate May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Connection: keep-alive May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Content-Length: 0 May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Host: 10.222.0.55 May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Openstack-Api-Version: compute 2.90 May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Openstack-System-Scope: None May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: User-Agent: python-novaclient May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Auth-Token: gAAAAABijPpITssjy8TKXKVV80oSQQ2U15Qe6yJGIkUPiP0rmwbjVkAqk1dy-wnvWuwP29j7rVk5jXZt8jOhyNcFD6sEZqyHrMtqekXbctKoyeOw6HKfZ3UX-TizbARBYSRWhnqrj7ewT4IFSiSBYHoRfmD0-NvjsZYMnu5UziDl-0BRJ7O6sG0 May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Domain-Id: None May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Domain-Name: None May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Identity-Status: Confirmed May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Is-Admin-Project: True May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Domain-Id: default May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Domain-Name: Default May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Project-Name: admin May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Role: reader,admin,member May 24 15:31:20.879747 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Roles: reader,admin,member May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Tenant: admin May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Tenant-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-Tenant-Name: admin May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User: admin May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Domain-Id: default May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Domain-Name: Default May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Id: 108385be6e5b428a910af5b70d71b0c3 May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: X-User-Name: admin May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: method: > May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: exception: Flavor 451 could not be found. May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: action_args: {'id': '451'} May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:31:20.881192 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:20.881957 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi May 24 15:31:20.883035 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-547e629e-e96c-45f0-9cbc-9b578803290f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:31:20.884064 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-547e629e-e96c-45f0-9cbc-9b578803290f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066854 May 24 15:31:20.884064 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 24/49] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 24 15:31:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 15:31:20.894387 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-3936dcc4-4a7a-48be-b598-a24e1dab5824 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:20.916903 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-3936dcc4-4a7a-48be-b598-a24e1dab5824 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028259 May 24 15:31:20.917449 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 26/50] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 24 15:31:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:31:20.929202 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:20.949032 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025144 May 24 15:31:20.949561 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 25/51] 10.222.0.55 () {60 vars in 1210 bytes} [Tue May 24 15:31:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:31:20.958934 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e803d51a-a0fe-4f92-832a-e0a9b292da28 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:20.964350 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.wsgi [None req-e803d51a-a0fe-4f92-832a-e0a9b292da28 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e803d51a-a0fe-4f92-832a-e0a9b292da28 admin admin] Request method failure captured: May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Accept: application/json May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Accept-Encoding: gzip, deflate May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Connection: keep-alive May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Content-Length: 0 May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Host: 10.222.0.55 May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Openstack-Api-Version: compute 2.90 May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Openstack-System-Scope: None May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: User-Agent: python-novaclient May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Auth-Token: gAAAAABijPpITssjy8TKXKVV80oSQQ2U15Qe6yJGIkUPiP0rmwbjVkAqk1dy-wnvWuwP29j7rVk5jXZt8jOhyNcFD6sEZqyHrMtqekXbctKoyeOw6HKfZ3UX-TizbARBYSRWhnqrj7ewT4IFSiSBYHoRfmD0-NvjsZYMnu5UziDl-0BRJ7O6sG0 May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Domain-Id: None May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Domain-Name: None May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Identity-Status: Confirmed May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Is-Admin-Project: True May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Openstack-Nova-Api-Version: 2.90 May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Id: default May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Domain-Name: Default May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Project-Name: admin May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Role: reader,admin,member May 24 15:31:20.965834 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Roles: reader,admin,member May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9a64b5dceb3e44fc817c5b6566c89325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Tenant: admin May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Tenant-Id: 9a64b5dceb3e44fc817c5b6566c89325 May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-Tenant-Name: admin May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User: admin May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Id: default May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Domain-Name: Default May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Id: 108385be6e5b428a910af5b70d71b0c3 May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: X-User-Name: admin May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: method: > May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: exception: Flavor 451 could not be found. May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: action_args: {'id': '451'} May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:31:20.967200 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:20.968076 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi May 24 15:31:20.969236 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e803d51a-a0fe-4f92-832a-e0a9b292da28 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:31:20.970285 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e803d51a-a0fe-4f92-832a-e0a9b292da28 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011842 May 24 15:31:20.970285 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 27/52] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 24 15:31:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 24 15:31:21.839064 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:21.840517 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001978 May 24 15:31:21.841080 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 26/53] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:31:22.041502 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1ca2ae54-0f99-4038-9b07-81ef88ab5d8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:31:22.061443 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1ca2ae54-0f99-4038-9b07-81ef88ab5d8a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.085570 May 24 15:31:22.061945 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 28/54] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 24 15:31:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:31:22.929739 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:22.930794 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 24 15:31:22.931188 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:31:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:31:23.133840 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-f3561f52-880b-4f60-b42c-5f51eeee1e30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:31:23.153486 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-f3561f52-880b-4f60-b42c-5f51eeee1e30 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.086452 May 24 15:31:23.154017 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 29/56] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 24 15:31:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:31:24.017775 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:24.018774 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 24 15:31:24.019164 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 28/57] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:31:24.212535 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-ad11ecd9-9510-4f35-b5ad-2f6aaf28bc58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:31:24.236969 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-ad11ecd9-9510-4f35-b5ad-2f6aaf28bc58 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.082468 May 24 15:31:24.237582 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 30/58] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 24 15:31:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:31:25.111144 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:25.112178 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 24 15:31:25.112607 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 29/59] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:31:25.324618 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c0df39e8-f681-4d42-8a0a-ae8daacacd70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:31:25.344657 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c0df39e8-f681-4d42-8a0a-ae8daacacd70 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.089250 May 24 15:31:25.345218 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 31/60] 10.222.0.55 () {64 vars in 1235 bytes} [Tue May 24 15:31:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:31:26.212674 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:26.213687 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 24 15:31:26.214089 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 30/61] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:31:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:31:26.416474 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-bef0108f-8e29-4aa7-aa7b-7c60e8dbdcd4 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:31:26.436197 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-bef0108f-8e29-4aa7-aa7b-7c60e8dbdcd4 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.087238 May 24 15:31:26.436605 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 32/62] 10.222.0.55 () {60 vars in 1202 bytes} [Tue May 24 15:31:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:32:27.821655 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:32:27.822892 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4f666776-6bf5-4207-8311-85691f2ff02f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 May 24 15:32:27.823293 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 31/63] 10.222.0.55 () {54 vars in 930 bytes} [Tue May 24 15:32:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:32:27.830636 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:32:27.891696 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-9903037d-e0d4-4dcc-8b6a-d3906737a49e admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:32:27.918709 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-9903037d-e0d4-4dcc-8b6a-d3906737a49e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.089449 May 24 15:32:27.919226 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 33/64] 10.222.0.55 () {60 vars in 1291 bytes} [Tue May 24 15:32:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:32:27.941021 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_api:SELECT=14 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:32:27.946508 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-24980c9f-6473-4d38-a8a9-e6eaad395a8f admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:32:27.959149 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-24980c9f-6473-4d38-a8a9-e6eaad395a8f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020087 May 24 15:32:27.960005 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 32/65] 10.222.0.55 () {60 vars in 1282 bytes} [Tue May 24 15:32:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:32:27.977700 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-d020c1d1-2920-45fb-bbb9-0db7a57e7fbf admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:32:27.989158 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-d020c1d1-2920-45fb-bbb9-0db7a57e7fbf admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016763 May 24 15:32:27.989939 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 34/66] 10.222.0.55 () {60 vars in 1285 bytes} [Tue May 24 15:32:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:32:28.001764 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-06976d83-2b0f-4376-9c12-aae5f4a38f4d admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:32:28.009783 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-06976d83-2b0f-4376-9c12-aae5f4a38f4d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011617 May 24 15:32:28.010288 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1285 bytes} [Tue May 24 15:32:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:32:28.022958 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-fe63b5ee-115d-4a8d-9d95-a95ac454c046 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:32:28.030987 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-fe63b5ee-115d-4a8d-9d95-a95ac454c046 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011546 May 24 15:32:28.031495 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 35/68] 10.222.0.55 () {60 vars in 1282 bytes} [Tue May 24 15:32:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:36:01.634515 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-06976d83-2b0f-4376-9c12-aae5f4a38f4d admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:01.635520 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-06976d83-2b0f-4376-9c12-aae5f4a38f4d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 24 15:36:01.635888 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:36:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:36:01.805634 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=6 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:01.932147 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-0520f1a8-dc36-4416-b8a5-ec899adeb37d admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:01.933314 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:36:01.933314 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: warnings.warn(msg) May 24 15:36:01.934579 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-0520f1a8-dc36-4416-b8a5-ec899adeb37d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:01.935014 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-0520f1a8-dc36-4416-b8a5-ec899adeb37d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:01.935782 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-0520f1a8-dc36-4416-b8a5-ec899adeb37d admin admin] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:01.936238 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-0520f1a8-dc36-4416-b8a5-ec899adeb37d admin admin] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:01.969811 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-0520f1a8-dc36-4416-b8a5-ec899adeb37d admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.167123 May 24 15:36:01.970369 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 36/70] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 24 15:36:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:36:02.843949 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-06976d83-2b0f-4376-9c12-aae5f4a38f4d admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:02.845059 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-06976d83-2b0f-4376-9c12-aae5f4a38f4d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 24 15:36:02.845456 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 35/71] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:36:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:36:03.042789 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1a203482-3c9d-451c-8fb3-6bbd89715474 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:03.043949 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:36:03.043949 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: warnings.warn(msg) May 24 15:36:03.045216 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-1a203482-3c9d-451c-8fb3-6bbd89715474 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:03.045650 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-1a203482-3c9d-451c-8fb3-6bbd89715474 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:03.046450 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-1a203482-3c9d-451c-8fb3-6bbd89715474 admin admin] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:03.046870 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-1a203482-3c9d-451c-8fb3-6bbd89715474 admin admin] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:03.065839 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1a203482-3c9d-451c-8fb3-6bbd89715474 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083307 May 24 15:36:03.066387 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 37/72] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 24 15:36:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:36:14.365286 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-06976d83-2b0f-4376-9c12-aae5f4a38f4d admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:14.366651 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-06976d83-2b0f-4376-9c12-aae5f4a38f4d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 May 24 15:36:14.367170 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 36/73] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:36:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:36:14.521939 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell0:SELECT=4 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:14.522654 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell1:SELECT=4 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:14.523390 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=8 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:36:14.573910 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-21d36a00-57c6-4140-8db2-4c7fead0dba4 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:14.575080 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:36:14.575080 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: warnings.warn(msg) May 24 15:36:14.576322 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-21d36a00-57c6-4140-8db2-4c7fead0dba4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:14.576748 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-21d36a00-57c6-4140-8db2-4c7fead0dba4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:14.577509 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-21d36a00-57c6-4140-8db2-4c7fead0dba4 admin admin] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:14.577922 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-21d36a00-57c6-4140-8db2-4c7fead0dba4 admin admin] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:14.602402 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-21d36a00-57c6-4140-8db2-4c7fead0dba4 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087728 May 24 15:36:14.602932 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 38/74] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 24 15:36:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:36:15.475641 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-06976d83-2b0f-4376-9c12-aae5f4a38f4d admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:15.476675 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-06976d83-2b0f-4376-9c12-aae5f4a38f4d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 24 15:36:15.477309 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 37/75] 10.222.0.55 () {56 vars in 1074 bytes} [Tue May 24 15:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:36:15.685455 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1b46e240-0fb1-4cca-937a-039a33de888f admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:36:15.686574 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 15:36:15.686574 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: warnings.warn(msg) May 24 15:36:15.688278 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-1b46e240-0fb1-4cca-937a-039a33de888f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:15.688917 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-1b46e240-0fb1-4cca-937a-039a33de888f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:15.690008 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-1b46e240-0fb1-4cca-937a-039a33de888f admin admin] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:36:15.690627 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-1b46e240-0fb1-4cca-937a-039a33de888f admin admin] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:36:15.718575 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1b46e240-0fb1-4cca-937a-039a33de888f admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.105655 May 24 15:36:15.719137 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 39/76] 10.222.0.55 () {60 vars in 1193 bytes} [Tue May 24 15:36:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:37:12.909004 dv-cinder-843153-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 24 15:37:12.910255 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: Tue May 24 15:37:12 2022 - graceful shutdown triggered... May 24 15:37:12.910780 dv-cinder-843153-1-iscsi devstack@n-api.service[103338]: Gracefully killing worker 2 (pid: 103338)... May 24 15:37:12.911132 dv-cinder-843153-1-iscsi devstack@n-api.service[103337]: Gracefully killing worker 1 (pid: 103337)... May 24 15:37:13.911487 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: worker 1 buried after 1 seconds May 24 15:37:13.911487 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: worker 2 buried after 1 seconds May 24 15:37:13.911487 dv-cinder-843153-1-iscsi devstack@n-api.service[103336]: goodbye to uWSGI. May 24 15:37:13.914026 dv-cinder-843153-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 24 15:37:13.914765 dv-cinder-843153-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 24 15:37:13.918283 dv-cinder-843153-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 15:37:13.934829 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 15:37:13 2022] *** May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: nodename: dv-cinder-843153-1-iscsi May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: machine: x86_64 May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: clock source: unix May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: pcre jit disabled May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: detected number of CPU cores: 4 May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: current working directory: / May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: detected binary path: /usr/bin/uwsgi-core May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: your processes number limit is 47680 May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: your memory page size is 4096 bytes May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: detected max file descriptor number: 2048 May 24 15:37:13.954098 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: lock engine: pthread robust mutexes May 24 15:37:13.955037 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: thunder lock: enabled May 24 15:37:13.955037 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 15:37:13.955037 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 15:37:14.001124 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: Python main interpreter initialized at 0x562f369259c0 May 24 15:37:14.001124 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: python threads support enabled May 24 15:37:14.001124 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: your server socket listen backlog is limited to 100 connections May 24 15:37:14.001124 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: your mercy for graceful operations on workers is 90 seconds May 24 15:37:14.001625 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: mapped 403077 bytes (393 KB) for 2 cores May 24 15:37:14.001625 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: *** Operational MODE: preforking *** May 24 15:37:14.001782 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: *** uWSGI is running in multiple interpreter mode *** May 24 15:37:14.001782 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: spawned uWSGI master process (pid: 129325) May 24 15:37:14.001986 dv-cinder-843153-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 15:37:14.002954 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: spawned uWSGI worker 1 (pid: 129339, cores: 1) May 24 15:37:14.002954 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: spawned uWSGI worker 2 (pid: 129340, cores: 1) May 24 15:37:14.003120 dv-cinder-843153-1-iscsi devstack@n-api.service[129325]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 15:37:15.159499 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 15:37:15.161188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 15:37:15.935537 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:37:15.935537 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: from cryptography.utils import int_from_bytes May 24 15:37:15.935923 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:37:15.935923 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: from cryptography.utils import int_from_bytes May 24 15:37:15.938122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:37:15.938122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: from cryptography.utils import int_from_bytes May 24 15:37:15.938424 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 15:37:15.938424 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: from cryptography.utils import int_from_bytes May 24 15:37:18.334822 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 15:37:18.335429 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 15:37:18.335522 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 15:37:18.335522 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 15:37:18.335940 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 15:37:18.335940 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 15:37:18.336337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 15:37:18.336435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 15:37:18.336520 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 15:37:18.336607 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.336679 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 15:37:18.336883 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.337036 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.337156 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.337334 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.337503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.337649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.337792 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.337968 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.338120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.338299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.338395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.338612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.338723 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.338941 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.339046 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.339281 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.339411 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.339579 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.339684 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.339829 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.339919 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843153-1-iscsi {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.340195 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.340342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.340510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843153-1-iscsi {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.340833 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.340987 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.341156 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.341337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.341479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.341664 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.341806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.341965 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.342114 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.342260 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.342407 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.342564 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.342738 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.343100 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.343405 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.343712 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.344084 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.344363 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.344596 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.344923 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.345142 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.345388 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.345628 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.345838 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.346039 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.346238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.346455 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.346657 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.346866 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.347082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.347294 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.347502 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.347710 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843153-1-iscsi {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.347930 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.348166 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.348381 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.348582 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.348789 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843153-1-iscsi {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.349001 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.349211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.349393 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.349578 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.349754 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.349913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.350239 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.350401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.350564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.350707 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.350887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.351229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.351387 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.351543 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.351696 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.351837 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.352053 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.352247 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.352434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.352587 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.352728 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.352893 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.353052 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.353575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.353834 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.354124 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.354273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.354422 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.354574 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.354725 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.354944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.355100 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.355248 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.355407 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.355547 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.355842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.356018 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.356196 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.356347 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.356494 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.356635 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.356797 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.356939 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.357091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.357231 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.357384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.357529 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.357679 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.357871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.358018 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.358160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.358931 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.359087 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.359236 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.359404 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.359553 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.359700 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.359840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.360345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.360551 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.360713 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.360863 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.361046 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.361386 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.361578 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.361842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.362000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.362170 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.362313 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.362461 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.362601 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.362740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.362889 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.363029 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.363199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.363586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.363869 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.364218 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.364218 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.364499 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.364499 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.364777 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.364931 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.365081 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.365266 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.365420 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.365567 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.365707 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.365848 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.366001 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.366150 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.366302 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.366461 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.366609 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.366762 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.366915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.367062 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.367209 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.367381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.367533 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.367682 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.367830 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.367830 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.368357 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.368505 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.368705 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.368705 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.368988 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.369127 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.369274 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.369445 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.369638 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.369793 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.369941 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.370087 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.370227 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.370381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.370653 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.370821 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.370963 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.371104 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.371253 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.371748 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.371913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.371913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.372261 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.372261 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.372533 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.372687 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.373007 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.373156 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.373317 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.373694 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.373961 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.374101 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.374351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.374498 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.374639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.374776 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.374921 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.375061 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.375213 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.375357 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.375504 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.375664 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.375894 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.376065 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.376212 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.376349 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.376495 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.376646 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.376785 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.376925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.377067 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.377207 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.377352 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.377516 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.377659 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.377797 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.377946 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.377946 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.378218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.378218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.378483 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.378483 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.378755 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.378891 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.379031 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.379031 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.379308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.379308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.379576 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.379712 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.379855 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.379855 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.380151 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.380297 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.380431 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.380566 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.380781 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.380920 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.381064 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.381221 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.381411 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.381552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.381701 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.381846 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.382089 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.382232 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.382377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.382521 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.382658 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.382796 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.382945 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.383089 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.383253 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.383390 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.383528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.383717 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.383932 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.384114 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.384261 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.384423 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.384555 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.384680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.384794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.384879 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.384961 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.385050 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.385136 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.385225 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.385309 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 15:37:18.385309 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.385471 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.385471 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.385669 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.385770 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.385863 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.385863 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386030 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386119 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386204 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386204 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386362 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386455 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386543 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386625 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386897 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.386981 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387061 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387061 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387327 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387418 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387501 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387690 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387790 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387886 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.387976 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.388127 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.388214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.388302 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.388385 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.388475 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.388573 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.388661 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.388750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.388833 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.388922 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389016 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389107 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389196 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389280 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389371 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389453 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389543 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389625 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389707 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389799 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389881 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.389971 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.390053 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.390143 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.390243 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.390326 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.390407 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.390496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.390587 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391002 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391108 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391194 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391283 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391379 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391463 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391554 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391636 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391718 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.391951 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.392057 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.392187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.392273 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.392367 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.392464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.392548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.392642 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.392732 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.392821 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.392949 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.393055 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.393140 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.393223 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.393365 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.393504 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.393630 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.393763 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.393887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.394018 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.394128 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.394244 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.394354 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.394354 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.394354 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.394724 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.394831 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.394952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.395069 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.395176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.395289 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.395397 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.395537 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.395651 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.395772 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.395890 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.395997 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.396208 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.396325 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.396510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.396681 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.396828 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.396977 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.397180 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.397956 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.398086 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.398210 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.398320 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.398320 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.398536 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.398653 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.398770 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.398878 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.398987 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.399115 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.399250 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.399377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.399516 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.399649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.399783 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.399916 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.400012 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.400173 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.400297 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.400456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.400626 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.400778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.400899 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.401047 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.401174 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.401411 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.401568 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.401728 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.401915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.402062 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.402264 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.402394 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.402577 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.402676 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.402887 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.402985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.403196 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.403293 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.403503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.403642 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.403809 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.404016 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.404204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.404651 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.404783 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.404874 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.405090 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.405192 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.405423 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.405514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.405749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.405843 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.406048 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.406136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.406356 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.406450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.406663 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.406752 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.406969 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.407059 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.407268 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.407364 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.407575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.407673 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.407874 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.407963 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.408203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.408290 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.408491 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.408580 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.408792 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.408891 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.409090 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.409187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.409398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.409564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.409697 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.409836 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.409998 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.410273 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.410367 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.410578 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.410680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.410897 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.410996 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.411203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.411301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.411505 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.411598 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.411805 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.411904 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.412135 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.412297 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.412474 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.412697 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.412864 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.412999 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.413204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.413366 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.413541 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.413675 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.413859 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.413997 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.414189 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.414340 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.414489 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.414633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.414803 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.414949 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.415115 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.415261 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.415406 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.415542 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.415718 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.415852 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.416023 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.416218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.416361 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.416504 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.416668 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.416795 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.416983 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.417082 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.417290 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.417388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.417609 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.417698 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.417916 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.418012 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.418230 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.418320 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.418529 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.418626 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.418840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.418931 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.419161 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.419249 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.419485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.419606 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.419782 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.419883 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.420111 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.420206 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.420419 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.420507 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.420732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.420831 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.421035 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.421134 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.421341 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.421440 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.421648 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.421749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.421952 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.422049 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.422261 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.422367 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.422565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.422656 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.422870 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.423015 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.423175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.423273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.423492 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.423589 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.423798 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.423894 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.424142 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.424297 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.424445 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.424536 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.424754 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.424851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.425063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.425188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.425375 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.425471 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.425684 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.425780 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.425990 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.426089 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.426295 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.426392 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.426603 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.426722 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.426909 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.427020 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.427219 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.427320 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.427519 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.427617 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.427820 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.427926 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.428171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.428276 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.428481 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.428572 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.428787 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.428921 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.429091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.429231 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.429389 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.429639 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.429747 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.429863 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.429991 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.430175 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.430294 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.430504 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.430605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.430830 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.430928 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.431138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.431229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.431444 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.431543 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.431767 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.431870 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.432099 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.432195 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.432403 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.432565 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.432701 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.432867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.433006 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.433222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.433315 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.433396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.433585 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.433683 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.433898 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.434043 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.434189 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.434279 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.434527 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.434618 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.434832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.434929 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.435132 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.435222 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.435442 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.435533 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.435750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.435846 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.436070 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.436163 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.436388 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.436490 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.436695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.436787 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.437000 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.437090 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.437308 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.437396 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.437615 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.437710 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.437918 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.438016 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.438223 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.438312 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.438527 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.438617 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.438833 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.438930 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.439138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.439233 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.439441 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.439530 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.439746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.439884 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.440074 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.440210 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.440374 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.440665 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.440767 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.440967 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.441110 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.441274 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.441414 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.441604 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.441832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.441979 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.442159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.442311 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.442473 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.442633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.442778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.442920 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.443073 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.443264 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.443410 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.443558 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.443710 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.443965 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.444145 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.444292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.444449 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.444617 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.444729 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.444907 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.445035 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.445213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.445338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.445520 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.445639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.445824 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.445946 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.446137 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.446231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.446441 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.446531 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.446746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.446836 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.447049 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.447141 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.447354 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.447453 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.447668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.447767 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.447964 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.448073 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.448290 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.448381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.448591 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.448698 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.448888 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.448978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.449193 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.449293 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.449491 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.449596 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.449805 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.450001 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.450098 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.450220 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.450384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.450483 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.450682 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.450780 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.450980 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.451078 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.451316 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.451417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.451620 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.451711 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.451955 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.452084 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.452301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.452398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.452622 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.452758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.452924 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.453022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.453224 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.453348 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.453525 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.453718 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.453822 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.453906 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.454114 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.454213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.454413 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.454504 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.454719 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.454893 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.455022 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.455121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.455317 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.455415 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.455621 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.455728 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.455937 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.456061 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.456245 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.456336 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.456548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.456651 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.456844 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.456935 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.457148 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.457247 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.457444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.457549 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.457743 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.457841 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.458045 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.458135 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.458344 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.458443 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.458641 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.458732 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.458946 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.459039 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.459244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.459345 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.459611 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.459703 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.460068 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.460226 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.460350 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.460452 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.460545 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.460629 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.460824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.460914 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.461123 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.461223 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.461419 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.461510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.461723 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.461824 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.462024 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.462123 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.462321 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.462420 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.462621 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.462720 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.462928 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.463031 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.463227 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.463318 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.463526 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.463640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.463828 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.463919 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.464153 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.464250 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.464453 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.464554 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.464762 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.464864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.465068 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.465167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.465373 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.465472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.465669 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.465759 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.465975 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.466072 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.466265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.466355 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.466564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.466652 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.466860 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.466955 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.467161 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.467251 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.467456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.467552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.467756 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.467844 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.468068 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.468163 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.468371 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.468475 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.468670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.468769 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.468972 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.469064 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.469274 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.469365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.469569 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.469672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.469869 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.469959 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.470169 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.470301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.470504 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.470619 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.470806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.470898 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.471157 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.471254 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.471458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.471558 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.471767 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.471901 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.472153 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.472489 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.472826 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.472933 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.473017 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.473097 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.473231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.473334 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.473432 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.473549 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.473624 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.473702 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.473867 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.473974 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.474182 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.474281 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.474508 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.474604 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.474849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.474959 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.475283 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.475380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.475519 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.475683 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.475837 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.475939 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.476145 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.476238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.476462 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.476555 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.476775 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.476913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.477088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.477187 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.477398 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.477487 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.477710 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.477819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.478190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.478325 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.478452 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.478562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.478673 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.478795 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.478906 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.478997 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.479190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.479282 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.479499 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.479604 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.479806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.479905 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.480134 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.480277 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.480477 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.480600 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.480757 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.480874 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.481066 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.481183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.481369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.481494 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.481677 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.481771 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.481980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.482079 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.482279 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.482388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.482580 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.482670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.482877 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.483066 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.483243 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.483334 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.483467 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.483623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.483899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.483997 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.484237 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.484339 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.484546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.484636 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.484850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.485014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.485156 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.485248 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.485459 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.485555 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.485766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.485864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.486140 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.486229 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.486443 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.486524 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.486770 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.486863 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.487074 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.487156 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.487378 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.487460 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.487799 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.487899 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.488121 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.488424 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.488514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.488729 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.488860 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.489038 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.489134 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.489338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.489461 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.489638 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.489781 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.490493 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.490748 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.490886 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.491000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.491120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.491240 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.491359 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.491469 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.491578 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.491696 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.491805 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.491921 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.492045 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.492377 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.492502 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.492627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.492736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.492906 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.493034 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.493299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.493416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.493555 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.493672 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.493908 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.494035 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.494858 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.494966 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.495086 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.495229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.495320 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.495435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.495562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.495679 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.495868 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.496008 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.496008 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.496388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.496388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.496670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.496670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.496967 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.497158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.497294 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.497428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.497554 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.497688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.497806 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.497932 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.498096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.498220 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.498347 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.498480 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.498599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.498730 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.498870 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.498974 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.499074 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.499159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.499242 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.499420 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.499546 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.499724 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.499857 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.500058 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.500187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.500369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.500491 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.500676 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.500828 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.500999 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.501113 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.501305 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.501406 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.501615 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.501755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.501925 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.502160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.502327 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.502486 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.502633 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.502775 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.502954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.503129 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.503314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.503499 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.503684 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.503859 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.504085 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.504300 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.504478 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.504674 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.504948 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.505150 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.505343 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.505519 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.505713 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.505865 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.506016 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.506155 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.506331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.506473 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.506627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.506941 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.507095 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.507236 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.507375 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.507522 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.507662 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.507812 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.507961 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.508130 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.508277 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.508417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.508601 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.508767 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.508915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.509063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.509210 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.509371 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.509526 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.509634 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.509728 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.509821 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.509913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510006 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510100 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510192 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510283 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510375 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510460 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510545 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510638 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510730 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510831 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.510917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.511004 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.511148 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.511284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.511456 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.511561 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.511764 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.511868 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.512089 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.512212 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.512397 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.512502 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.512701 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.512802 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.513015 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.513109 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.513314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.513416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.513629 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.513730 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.513935 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.514030 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.514243 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.514396 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.514549 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.514690 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.514829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.514925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.515145 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.515237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.515449 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.515562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.515778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.515891 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.516120 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.516235 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.516438 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.516553 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.516760 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.516861 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.517069 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.517162 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.517389 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.517496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.517703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.517804 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.518014 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.518106 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.518325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.518431 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.518639 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.518737 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.518946 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.519038 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.519255 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.519362 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.519563 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.519657 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.519867 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.519960 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.520203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.520299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.520516 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.520609 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.520828 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.520933 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.521380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.521482 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.521704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.521797 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.522139 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.522250 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.522407 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.522538 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.522724 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.522865 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.523002 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.523151 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.523301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.523448 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.523597 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.523750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.523914 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.524120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.524260 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.524438 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.524581 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.524749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.524912 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.525075 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.525177 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.525395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.525560 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.525722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.525847 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.526055 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.526158 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.526367 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.526469 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.526676 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.526832 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.526977 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.527122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.527287 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.527428 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.527641 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.527796 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.527942 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.528133 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.528297 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.528452 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.528612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.528759 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.528902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.529053 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.529194 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.529612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.529769 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.529900 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.530073 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.530228 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.530384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.530529 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.530691 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.530843 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.530999 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.531157 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.531308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.531458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.531619 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.531774 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.531928 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.532126 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.532347 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.532521 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.532675 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.532815 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.532950 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.533089 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.533308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.533456 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.533604 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.533758 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.533897 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.534200 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.534354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.534500 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.534639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.534841 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.534986 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.535171 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.535317 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.535497 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.535652 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.535829 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.535963 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.536160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.536314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.536488 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.536589 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.536792 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.536883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.537096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.537188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.537401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.537533 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.537776 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.537896 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.538086 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.538207 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.538413 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.538533 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.538725 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.538844 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.539031 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.539144 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.539357 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.539457 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.539668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.539758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.540233 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.540328 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.540586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.540689 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.540909 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.541009 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.541237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.541329 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.541567 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.541679 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.541883 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.541982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.542190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.542289 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.542516 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.542625 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.542818 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.542917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.543120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.543223 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.543435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.543534 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.543778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.543881 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.544103 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.544197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.544445 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.544552 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.544755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.544847 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.545062 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.545196 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.545362 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.545487 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.545671 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.545806 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.545972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.546063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.546292 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.546384 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.546597 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.546722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.546898 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.546996 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.547200 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.547291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.547509 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.547599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.547812 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.547904 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.548138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.548250 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.548440 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.548530 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.548740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.548846 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.549049 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.549149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.549348 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.549446 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.549654 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.549745 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.549954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.550054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.550262 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.550362 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.550563 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.550661 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.550867 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.550967 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.551217 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.551308 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.551553 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.551690 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.551835 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.551936 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.552160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.552290 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.552491 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.552598 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.552781 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.552907 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.553100 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.553329 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.553472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.553566 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.553754 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.553874 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.554095 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.554192 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.554412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.554514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.554942 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.555044 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.555269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.555364 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.555587 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.555694 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.555913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.556231 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.556336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.556424 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.556562 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.556671 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.556864 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.556958 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.557164 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.557256 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.557485 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.557592 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.557793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.557924 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.558101 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.558214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.558409 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.558536 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.558715 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.558850 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.559020 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.559113 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.559326 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.559430 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.559633 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.559733 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.559940 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.560176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.560281 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.560431 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.560568 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.560675 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.560873 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.560966 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.561191 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.561286 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.561487 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.561581 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.561830 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.561944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.562146 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.562244 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.562457 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.562548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.562768 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.562944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.563083 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.563201 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.563391 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.563504 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.563694 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.563800 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.564000 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.564126 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.564330 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.564421 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.564639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.564732 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.564963 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.565064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.565275 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.565367 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.565576 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.565675 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.565994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.566098 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.566306 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.566416 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.566619 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.566711 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.566938 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.567028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.567244 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.567347 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.567560 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.567660 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.567879 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.567989 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.568211 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.568313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.568529 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.568620 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.568862 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.568962 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.569185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.569330 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.569517 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.569655 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.569840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.569988 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.570160 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.570323 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.570462 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.570635 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.570763 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.570941 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.571064 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.571245 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.571369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.571555 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.571683 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.571878 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.571982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.572214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.572316 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.572519 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.572620 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.572825 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.572931 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.573135 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.573235 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.573440 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.573543 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.573734 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.573827 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.574033 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.574134 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.574334 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.574432 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.574631 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.574731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.574929 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.575031 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.575227 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.575319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.575523 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.575671 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.575817 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.575917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.576166 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.576271 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.576431 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.576527 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.576709 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.576812 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.577006 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.577112 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.577301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.577402 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.577599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.577746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.577895 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.577997 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.578193 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.578293 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.578526 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.578629 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.578831 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.578930 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.579150 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.579244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.579456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.579549 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.579766 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.579858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.580087 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.580196 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.580403 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.580496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.580718 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.580812 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.581026 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.581117 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.581333 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.581434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.581640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.581732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.581952 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.582051 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.582261 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.582361 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.582566 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.582668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.582871 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.583015 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.583175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.583282 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.583482 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.583615 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.583795 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.583896 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.584145 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.584258 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.584538 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.584697 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.584847 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.585001 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.585163 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.585297 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.585502 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.585592 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.585785 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.585941 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.586095 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.586257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.586405 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.586539 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.586716 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.586809 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.587022 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.587116 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.587329 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.587419 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.587634 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.587732 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.587942 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.588107 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.588276 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.588368 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.588584 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.588683 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.588899 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.588998 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.589741 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.589864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.589955 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.590051 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.590146 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.590232 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.590324 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.590417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.590515 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.590610 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.590774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.590875 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.591094 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.591188 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.591419 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.591600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.591731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.591831 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.592158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.592267 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.592372 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.592524 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.592618 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 15:37:18.592833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 15:37:18.593076 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 15:37:18.651227 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO dbcounter [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Registered counter for database nova_api May 24 15:37:18.651450 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO dbcounter [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Registered counter for database nova_api May 24 15:37:18.672331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_db.sqlalchemy.engines [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:37:18.674362 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_db.sqlalchemy.engines [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:37:18.682783 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writer thread running {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:37:18.683386 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writer thread running {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:37:18.738075 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.context [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),524ab7f1-ba78-4fd5-b69d-b9e525298061(cell1) {{(pid=129339) load_cells /opt/stack/nova/nova/context.py:464}} May 24 15:37:18.742309 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:18.743046 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.context [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),524ab7f1-ba78-4fd5-b69d-b9e525298061(cell1) {{(pid=129340) load_cells /opt/stack/nova/nova/context.py:464}} May 24 15:37:18.743880 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:18.744696 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:18.746650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:18.747180 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:18.748638 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO dbcounter [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Registered counter for database nova_cell0 May 24 15:37:18.748790 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:18.749586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:37:18.751658 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:37:18.752600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO dbcounter [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Registered counter for database nova_cell1 May 24 15:37:18.753659 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO dbcounter [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Registered counter for database nova_cell0 May 24 15:37:18.757793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO dbcounter [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Registered counter for database nova_cell1 May 24 15:37:18.761616 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_db.sqlalchemy.engines [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:37:18.763706 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_db.sqlalchemy.engines [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:37:18.764613 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_db.sqlalchemy.engines [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:37:18.766067 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writer thread running {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:37:18.766880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_db.sqlalchemy.engines [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:37:18.771091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writer thread running {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:37:18.907989 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writer thread running {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:37:18.909664 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writer thread running {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:37:18.917359 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO dbcounter [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Registered counter for database nova_cell0 May 24 15:37:18.920650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO dbcounter [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Registered counter for database nova_cell0 May 24 15:37:18.924497 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_db.sqlalchemy.engines [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:37:18.928405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_db.sqlalchemy.engines [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 15:37:18.929599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writer thread running {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:37:18.932989 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writer thread running {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 15:37:19.240881 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: WARNING keystonemiddleware.auth_token [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:37:19.248201 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: WARNING keystonemiddleware.auth_token [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:37:19.252295 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: WARNING keystonemiddleware.auth_token [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:37:19.260463 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: WARNING keystonemiddleware.auth_token [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:37:19.589567 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: WARNING keystonemiddleware.auth_token [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:37:19.595607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: WARNING keystonemiddleware.auth_token [None req-694c4757-e662-41ff-9a54-ca1648c72f35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:37:19.601046 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f369259c0 pid: 129339 (default app) May 24 15:37:19.606222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: WARNING keystonemiddleware.auth_token [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 15:37:19.612247 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: WARNING keystonemiddleware.auth_token [None req-16c5ec66-9316-4299-8f2f-fae25097300b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 15:37:19.617576 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f369259c0 pid: 129340 (default app) May 24 15:38:01.495038 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=3 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:01.497194 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=3 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:01.498889 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=3 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:01.500233 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=3 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:02.608265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=3 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:02.608960 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=3 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:02.613198 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=3 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:02.617858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=3 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:03.081034 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bb141dc9-ffc8-42e2-a178-9a0f688d903c tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Action: 'create', calling method: .version_select at 0x7fb1d68e0ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-416255143"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:04.378163 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1182143850", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "networks": [{"uuid": "00b154da-a072-42ec-9708-34a9d5f5fcf6"}]}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:05.777057 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] validate_networks() for [('00b154da-a072-42ec-9708-34a9d5f5fcf6', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:38:05.845760 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bb141dc9-ffc8-42e2-a178-9a0f688d903c tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.358510 May 24 15:38:05.854280 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1154 bytes} [Tue May 24 15:38:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4363 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 15:38:05.883822 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bff915c8-4c1e-44d2-9295-77951487e75b tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d672fc10>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:06.050011 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bff915c8-4c1e-44d2-9295-77951487e75b tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad" status: 200 len: 344 microversion: 2.1 time: 0.195071 May 24 15:38:06.050976 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 2/2] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:38:05 2022] GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad => generated 344 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:07.063311 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5af378b7-6a9a-49a4-91e9-be3fdddb2c61 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d672fdc0>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:07.203165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5af378b7-6a9a-49a4-91e9-be3fdddb2c61 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad" status: 200 len: 345 microversion: 2.1 time: 0.143822 May 24 15:38:07.203728 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 3/3] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:38:07 2022] GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:07.215509 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d9692a83-ff52-4f08-bb33-4c1195402b2e tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Action: 'create', calling method: .version_select at 0x7fb1d6740310>, body: {"snapshot": {"volume_id": "7d0eb898-7a45-42b3-b050-b3abea484dad", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1907881070"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:07.733680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d9692a83-ff52-4f08-bb33-4c1195402b2e tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.522175 May 24 15:38:07.734278 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 4/4] 10.222.0.55 () {60 vars in 1161 bytes} [Tue May 24 15:38:07 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:38:07.745324 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-aa4d58f1-0afe-4cf9-97a4-bf87ea78b934 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d6740f70>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:07.885042 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-aa4d58f1-0afe-4cf9-97a4-bf87ea78b934 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1" status: 200 len: 287 microversion: 2.1 time: 0.143858 May 24 15:38:07.885906 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 5/5] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 24 15:38:07 2022] GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:07.897069 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a476c4c5-74ca-4354-b5ad-06a68dfcf878 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d6740b80>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:08.024713 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a476c4c5-74ca-4354-b5ad-06a68dfcf878 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.133080 May 24 15:38:08.025680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 6/6] 10.222.0.55 () {58 vars in 1139 bytes} [Tue May 24 15:38:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:08.035935 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-159b84ae-875a-43d4-9d04-6a1fb13d6d42 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d672fa60>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:08.051077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:38:08.051604 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:38:08.052155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:38:08.052733 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:38:08.053270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:38:08.078963 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:08.079769 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:08.080825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:08.081450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:08.104497 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-159b84ae-875a-43d4-9d04-6a1fb13d6d42 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1" status: 200 len: 287 microversion: 2.1 time: 0.072192 May 24 15:38:08.105064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 7/7] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 24 15:38:08 2022] GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:38:08.117324 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Getting quotas for project f86f8a870f9146489a3ef1716094e066. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:38:08.124751 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Getting quotas for user e9f6a35cac50431d9468b51c9259bdb5 and project f86f8a870f9146489a3ef1716094e066. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:38:08.144653 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:38:08.157780 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:38:08.294202 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fe86294c-e89c-4b2f-954c-8308b28d472e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.702685 May 24 15:38:08.308718 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 1/8] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 5719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:38:08.313143 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b225197f-034c-4f41-b15c-72f51e59d4ad tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:08.314046 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b225197f-034c-4f41-b15c-72f51e59d4ad tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:08.516967 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b225197f-034c-4f41-b15c-72f51e59d4ad tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:08.550556 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b225197f-034c-4f41-b15c-72f51e59d4ad tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1215 microversion: 2.1 time: 0.239385 May 24 15:38:08.551288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 8/9] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:08 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1215 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:09.119562 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-5f76142a-f42a-40e0-9eb9-7150ac9fd29d tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d66d8b80>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:09.271663 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-5f76142a-f42a-40e0-9eb9-7150ac9fd29d tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1" status: 200 len: 287 microversion: 2.1 time: 0.158589 May 24 15:38:09.276104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 2/10] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 24 15:38:09 2022] GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:09.569530 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1f4b2428-3a79-4ecf-9e60-9d9bf83dad48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:09.571165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1f4b2428-3a79-4ecf-9e60-9d9bf83dad48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:09.966966 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1f4b2428-3a79-4ecf-9e60-9d9bf83dad48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:09.990188 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1f4b2428-3a79-4ecf-9e60-9d9bf83dad48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1215 microversion: 2.1 time: 0.425278 May 24 15:38:10.007312 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 9/11] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:09 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1215 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:10.284991 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-54ca1c0b-01fa-4214-8385-6ab234515e00 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d5650790>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:10.339901 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-54ca1c0b-01fa-4214-8385-6ab234515e00 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1" status: 200 len: 287 microversion: 2.1 time: 0.060201 May 24 15:38:10.345111 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 3/12] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 24 15:38:10 2022] GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:11.007173 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-34e79d88-e04e-4192-96db-aa2a76a53805 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:11.009343 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-34e79d88-e04e-4192-96db-aa2a76a53805 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:11.020150 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-34e79d88-e04e-4192-96db-aa2a76a53805 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:11.023735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-34e79d88-e04e-4192-96db-aa2a76a53805 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:11.025041 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-34e79d88-e04e-4192-96db-aa2a76a53805 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:11.026143 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-34e79d88-e04e-4192-96db-aa2a76a53805 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:11.309655 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-34e79d88-e04e-4192-96db-aa2a76a53805 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:11.338411 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-34e79d88-e04e-4192-96db-aa2a76a53805 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1219 microversion: 2.1 time: 0.335287 May 24 15:38:11.340092 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 10/13] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:11 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1219 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:11.355774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ed062028-83dc-43b3-ac5a-eef29dc046c3 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d5650e50>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:11.398009 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ed062028-83dc-43b3-ac5a-eef29dc046c3 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1" status: 200 len: 288 microversion: 2.1 time: 0.046020 May 24 15:38:11.408740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 4/14] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 24 15:38:11 2022] GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 => generated 288 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:11.409525 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4a89040d-6402-466f-b8b9-05ec4dbd54bf tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d6696430>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:11.506680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4a89040d-6402-466f-b8b9-05ec4dbd54bf tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1" status: 202 len: 0 microversion: 2.1 time: 0.100239 May 24 15:38:11.516474 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 11/15] 10.222.0.55 () {58 vars in 1253 bytes} [Tue May 24 15:38:11 2022] DELETE /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 15:38:11.516720 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cbb2c456-942d-4fbc-bdd8-12eaf245b4e8 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d5650d30>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:11.566451 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cbb2c456-942d-4fbc-bdd8-12eaf245b4e8 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1" status: 200 len: 287 microversion: 2.1 time: 0.054118 May 24 15:38:11.571848 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 5/16] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 24 15:38:11 2022] GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:12.359172 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-42a0e9b1-0cbb-4cfe-aa99-5512c5593180 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:12.359768 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-42a0e9b1-0cbb-4cfe-aa99-5512c5593180 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:12.374957 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-42a0e9b1-0cbb-4cfe-aa99-5512c5593180 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:12.375396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-42a0e9b1-0cbb-4cfe-aa99-5512c5593180 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:12.382383 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-42a0e9b1-0cbb-4cfe-aa99-5512c5593180 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:12.382866 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-42a0e9b1-0cbb-4cfe-aa99-5512c5593180 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:12.492276 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-42a0e9b1-0cbb-4cfe-aa99-5512c5593180 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:12.500892 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-42a0e9b1-0cbb-4cfe-aa99-5512c5593180 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1211 microversion: 2.1 time: 0.146303 May 24 15:38:12.502095 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 12/17] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:12 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1211 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:12.578928 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b63fa3df-fc5d-4f37-86cb-c39ebc6f4e24 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d5650670>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:12.632269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b63fa3df-fc5d-4f37-86cb-c39ebc6f4e24 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1" status: 200 len: 287 microversion: 2.1 time: 0.057256 May 24 15:38:12.632946 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 6/18] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 24 15:38:12 2022] GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:13.523362 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3de9ede2-5156-437f-a425-080be579ce7e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:13.523991 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3de9ede2-5156-437f-a425-080be579ce7e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:13.536333 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3de9ede2-5156-437f-a425-080be579ce7e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:13.538559 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3de9ede2-5156-437f-a425-080be579ce7e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:13.546455 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3de9ede2-5156-437f-a425-080be579ce7e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:13.547142 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3de9ede2-5156-437f-a425-080be579ce7e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:13.659862 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-24a7e076-d596-410d-ac74-19cafb48ab30 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d565c5e0>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:13.734903 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-3de9ede2-5156-437f-a425-080be579ce7e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:13.750140 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3de9ede2-5156-437f-a425-080be579ce7e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1211 microversion: 2.1 time: 0.227935 May 24 15:38:13.752856 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 13/19] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:13 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1211 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:13.762904 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-24a7e076-d596-410d-ac74-19cafb48ab30 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1" status: 200 len: 287 microversion: 2.1 time: 0.120556 May 24 15:38:13.763606 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 7/20] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 24 15:38:13 2022] GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:14.233269 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2128637644", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:14.324877 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-bd6abb17-bccc-46c7-aeef-616d70a5f831 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Action: 'create', calling method: .version_select at 0x7fb1d565cc10>, body: {"keypair": {"name": "tempest-keypair-255421339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbTLmyF2Fhc1CzonbFBwL3bZkQhF03WfzfL/SRjJfeZOIdc7xXAG9HeFXhFnayAVRifF5OZXRSOIO8yhz/7Xjmx/DJZbbRS9us5gbY80QXEFGqD9lex/n9WIjkq/McuYQ=="}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:14.394282 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-bd6abb17-bccc-46c7-aeef-616d70a5f831 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Getting quotas for project fd0613f4cbb3461a982738c683c3ab03. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:38:14.403236 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-bd6abb17-bccc-46c7-aeef-616d70a5f831 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Getting quotas for user 9bb20bf4c31d44ac9dd9ef0db9a2a63a and project fd0613f4cbb3461a982738c683c3ab03. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:38:14.472598 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] validate_networks() for [('b1d908b4-0d57-4328-b5e8-f2842546189b', None, None, None, None, None)] {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:38:14.480312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-bd6abb17-bccc-46c7-aeef-616d70a5f831 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.705847 May 24 15:38:14.483393 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 8/21] 10.222.0.55 () {62 vars in 1199 bytes} [Tue May 24 15:38:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 711 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 24 15:38:14.775601 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0c7e0212-75a0-416c-b858-5ea4f575c9d1 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d55f4280>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:14.881659 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-0c7e0212-75a0-416c-b858-5ea4f575c9d1 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] HTTP exception thrown: Snapshot 4f856d5c-04ac-45e7-9163-8e891934dcd1 could not be found. May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0c7e0212-75a0-416c-b858-5ea4f575c9d1 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Request method failure captured: May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 HTTP/1.1 May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPvZec5vE4pNJh2Oz8HT8PDSbT-boJ9ZVTp-ENL-BaqOe8mDfGMPj6-dBP0zV0iSMJq118mJMpg05KkGYZ8URp5H3pb7flizgf3eBL8fqozMy8NR6KbRokkyA1Fv43zMlpvNlMWwTYw3F7Hep7-qOEGfKniw6o0pW9vevnA9mMBwwd0 May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 2a6ea8ff8d114436bca2e300d9c01eea May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:38:14.886126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 2a6ea8ff8d114436bca2e300d9c01eea May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-VolumesSnapshotsTestJSON-170056783-project May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: eff6a47a57734cc5828b6187d4cc908f May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170056783-project May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Snapshot 4f856d5c-04ac-45e7-9163-8e891934dcd1 could not be found. May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '4f856d5c-04ac-45e7-9163-8e891934dcd1'} May 24 15:38:14.887284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4f856d5c-04ac-45e7-9163-8e891934dcd1 could not be found. (HTTP 404) (Request-ID: req-bb24237e-4230-46f7-96ed-a1887e19bc27) May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:14.887920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:38:14.889338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4f856d5c-04ac-45e7-9163-8e891934dcd1 could not be found. May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 24 15:38:14.890238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4f856d5c-04ac-45e7-9163-8e891934dcd1 could not be found. May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4f856d5c-04ac-45e7-9163-8e891934dcd1 could not be found. May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0c7e0212-75a0-416c-b858-5ea4f575c9d1 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Returning 404 to user: Snapshot 4f856d5c-04ac-45e7-9163-8e891934dcd1 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:38:14.893184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0c7e0212-75a0-416c-b858-5ea4f575c9d1 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1" status: 404 len: 111 microversion: 2.1 time: 0.117138 May 24 15:38:14.896873 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 9/22] 10.222.0.55 () {58 vars in 1250 bytes} [Tue May 24 15:38:14 2022] GET /compute/v2.1/os-snapshots/4f856d5c-04ac-45e7-9163-8e891934dcd1 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:38:14.905150 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-eebcd58d-bdf9-4efb-9662-864685e5f78e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:14.905846 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-eebcd58d-bdf9-4efb-9662-864685e5f78e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:14.958327 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eebcd58d-bdf9-4efb-9662-864685e5f78e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:14.968657 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eebcd58d-bdf9-4efb-9662-864685e5f78e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:14.971870 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eebcd58d-bdf9-4efb-9662-864685e5f78e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:14.977438 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eebcd58d-bdf9-4efb-9662-864685e5f78e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:15.368771 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-eebcd58d-bdf9-4efb-9662-864685e5f78e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:15.401408 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-eebcd58d-bdf9-4efb-9662-864685e5f78e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1275 microversion: 2.1 time: 0.501281 May 24 15:38:15.402504 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 10/23] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:14 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1275 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:15.423287 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d698e09b-5ca2-464a-9a0d-455de8b595c8 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d4d115e0>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:15.606920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d698e09b-5ca2-464a-9a0d-455de8b595c8 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad" status: 202 len: 0 microversion: 2.1 time: 0.196950 May 24 15:38:15.610821 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 11/24] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 24 15:38:15 2022] DELETE /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:38:15.617220 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-91c6bb43-ed5b-49fc-a5c6-0383bd6fc657 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d4cb21f0>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:15.737653 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-91c6bb43-ed5b-49fc-a5c6-0383bd6fc657 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad" status: 200 len: 344 microversion: 2.1 time: 0.125346 May 24 15:38:15.738425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 12/25] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:38:15 2022] GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad => generated 344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:38:16.420228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-db858975-4cab-42a4-a940-e6982c9a26f5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:16.420835 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-db858975-4cab-42a4-a940-e6982c9a26f5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:16.427303 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-db858975-4cab-42a4-a940-e6982c9a26f5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.427753 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-db858975-4cab-42a4-a940-e6982c9a26f5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.428552 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-db858975-4cab-42a4-a940-e6982c9a26f5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.428988 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-db858975-4cab-42a4-a940-e6982c9a26f5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.562550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:38:16.563723 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:38:16.564359 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:38:16.567029 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:38:16.567709 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:38:16.605659 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.612062 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.613848 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:16.614416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:16.662496 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-db858975-4cab-42a4-a940-e6982c9a26f5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:16.678516 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-db858975-4cab-42a4-a940-e6982c9a26f5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1275 microversion: 2.1 time: 0.260980 May 24 15:38:16.690818 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 13/26] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:16 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1275 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:16.741101 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Getting quotas for project e280d545f6064b5c91289a77e2491511. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:38:16.748351 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Getting quotas for user 6d07884e92bc4cfe95d2fd99c40f25f0 and project e280d545f6064b5c91289a77e2491511. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:38:16.752753 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1b93a5fc-f789-4c7c-bac2-77dceb275aca tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d4cb2550>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:16.782494 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:38:16.787392 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:38:16.875840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1b93a5fc-f789-4c7c-bac2-77dceb275aca tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad" status: 200 len: 344 microversion: 2.1 time: 0.127558 May 24 15:38:16.876813 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 14/27] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:38:16 2022] GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad => generated 344 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:16.953165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-09d2f30f-7836-40f2-abea-b9dba53f5cfc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.198133 May 24 15:38:16.960350 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 14/28] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:38:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:38:16.965512 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-74b03f21-6c43-4973-824a-eda69e4d40e2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:16.966679 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-74b03f21-6c43-4973-824a-eda69e4d40e2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:17.351466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-74b03f21-6c43-4973-824a-eda69e4d40e2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:17.368879 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-74b03f21-6c43-4973-824a-eda69e4d40e2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1222 microversion: 2.1 time: 0.407336 May 24 15:38:17.381331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 15/29] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:16 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1222 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:17.633080 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-366605584", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:17.697398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ce7f4704-95e7-4029-a79b-108dcf6f3d40 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:17.698018 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ce7f4704-95e7-4029-a79b-108dcf6f3d40 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:17.713251 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ce7f4704-95e7-4029-a79b-108dcf6f3d40 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:17.714334 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ce7f4704-95e7-4029-a79b-108dcf6f3d40 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:17.715324 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ce7f4704-95e7-4029-a79b-108dcf6f3d40 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:17.716000 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ce7f4704-95e7-4029-a79b-108dcf6f3d40 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:17.797306 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] validate_networks() for [('b1d908b4-0d57-4328-b5e8-f2842546189b', None, None, None, None, None)] {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:38:18.084252 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ce7f4704-95e7-4029-a79b-108dcf6f3d40 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:18.094420 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ce7f4704-95e7-4029-a79b-108dcf6f3d40 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1273 microversion: 2.1 time: 0.401331 May 24 15:38:18.098844 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 16/30] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:17 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1273 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:18.110799 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3321f99a-6b20-4744-bc2a-467c7a947512 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d4cb24c0>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:18.125954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:18.177046 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-3321f99a-6b20-4744-bc2a-467c7a947512 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] HTTP exception thrown: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3321f99a-6b20-4744-bc2a-467c7a947512 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Request method failure captured: May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad HTTP/1.1 May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPvZec5vE4pNJh2Oz8HT8PDSbT-boJ9ZVTp-ENL-BaqOe8mDfGMPj6-dBP0zV0iSMJq118mJMpg05KkGYZ8URp5H3pb7flizgf3eBL8fqozMy8NR6KbRokkyA1Fv43zMlpvNlMWwTYw3F7Hep7-qOEGfKniw6o0pW9vevnA9mMBwwd0 May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 2a6ea8ff8d114436bca2e300d9c01eea May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:38:18.179649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 2a6ea8ff8d114436bca2e300d9c01eea May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-VolumesSnapshotsTestJSON-170056783-project May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: eff6a47a57734cc5828b6187d4cc908f May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170056783-project May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '7d0eb898-7a45-42b3-b050-b3abea484dad'} May 24 15:38:18.180899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. (HTTP 404) (Request-ID: req-d414d10a-0824-4482-8c86-d210c8e9bce4) May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:18.181546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:38:18.182464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 15:38:18.183351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3321f99a-6b20-4744-bc2a-467c7a947512 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Returning 404 to user: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3321f99a-6b20-4744-bc2a-467c7a947512 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad" status: 404 len: 109 microversion: 2.1 time: 0.081200 May 24 15:38:18.191915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 17/31] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:38:18 2022] GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:38:18.198821 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7e3b7562-d3b8-492b-8df1-a9ce0c4209d3 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d4cd6280>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:18.425193 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-7e3b7562-d3b8-492b-8df1-a9ce0c4209d3 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] HTTP exception thrown: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7e3b7562-d3b8-492b-8df1-a9ce0c4209d3 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Request method failure captured: May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: DELETE /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad HTTP/1.1 May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPvZec5vE4pNJh2Oz8HT8PDSbT-boJ9ZVTp-ENL-BaqOe8mDfGMPj6-dBP0zV0iSMJq118mJMpg05KkGYZ8URp5H3pb7flizgf3eBL8fqozMy8NR6KbRokkyA1Fv43zMlpvNlMWwTYw3F7Hep7-qOEGfKniw6o0pW9vevnA9mMBwwd0 May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 2a6ea8ff8d114436bca2e300d9c01eea May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:38:18.429599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 2a6ea8ff8d114436bca2e300d9c01eea May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-VolumesSnapshotsTestJSON-170056783-project May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: eff6a47a57734cc5828b6187d4cc908f May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170056783-project May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '7d0eb898-7a45-42b3-b050-b3abea484dad'} May 24 15:38:18.430714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. (HTTP 404) (Request-ID: req-5d87ca63-c28b-4859-ae55-80b11d4d35ee) May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:18.431435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:38:18.432384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 15:38:18.433312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7e3b7562-d3b8-492b-8df1-a9ce0c4209d3 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Returning 404 to user: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:38:18.434211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7e3b7562-d3b8-492b-8df1-a9ce0c4209d3 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad" status: 404 len: 109 microversion: 2.1 time: 0.239866 May 24 15:38:18.437384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 18/32] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 24 15:38:18 2022] DELETE /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad => generated 109 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:38:18.459809 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b331ffdc-9dac-443a-a015-3fbea179cf68 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Calling method '.version_select at 0x7fb1d4cb21f0>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:18.648844 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-b331ffdc-9dac-443a-a015-3fbea179cf68 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] HTTP exception thrown: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b331ffdc-9dac-443a-a015-3fbea179cf68 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Request method failure captured: May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad HTTP/1.1 May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPvZec5vE4pNJh2Oz8HT8PDSbT-boJ9ZVTp-ENL-BaqOe8mDfGMPj6-dBP0zV0iSMJq118mJMpg05KkGYZ8URp5H3pb7flizgf3eBL8fqozMy8NR6KbRokkyA1Fv43zMlpvNlMWwTYw3F7Hep7-qOEGfKniw6o0pW9vevnA9mMBwwd0 May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 2a6ea8ff8d114436bca2e300d9c01eea May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:38:18.651042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2a6ea8ff8d114436bca2e300d9c01eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 2a6ea8ff8d114436bca2e300d9c01eea May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-170056783 May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-VolumesSnapshotsTestJSON-170056783-project May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: eff6a47a57734cc5828b6187d4cc908f May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-170056783-project May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '7d0eb898-7a45-42b3-b050-b3abea484dad'} May 24 15:38:18.653175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. (HTTP 404) (Request-ID: req-ad168a7e-671a-4cd4-a0f1-53f1c1e0a041) May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:18.653824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:38:18.655565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 15:38:18.656544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b331ffdc-9dac-443a-a015-3fbea179cf68 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] Returning 404 to user: Volume 7d0eb898-7a45-42b3-b050-b3abea484dad could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b331ffdc-9dac-443a-a015-3fbea179cf68 tempest-VolumesSnapshotsTestJSON-170056783 tempest-VolumesSnapshotsTestJSON-170056783-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad" status: 404 len: 109 microversion: 2.1 time: 0.214089 May 24 15:38:18.657455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 19/33] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:38:18 2022] GET /compute/v2.1/os-volumes/7d0eb898-7a45-42b3-b050-b3abea484dad => generated 109 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:38:19.117075 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6a500c1d-2746-4722-abda-1058a1d90441 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:19.117713 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6a500c1d-2746-4722-abda-1058a1d90441 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:19.131666 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6a500c1d-2746-4722-abda-1058a1d90441 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:19.135026 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6a500c1d-2746-4722-abda-1058a1d90441 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:19.136383 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6a500c1d-2746-4722-abda-1058a1d90441 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:19.138867 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6a500c1d-2746-4722-abda-1058a1d90441 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:19.925281 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6a500c1d-2746-4722-abda-1058a1d90441 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:19.957521 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6a500c1d-2746-4722-abda-1058a1d90441 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1273 microversion: 2.1 time: 0.845212 May 24 15:38:19.958235 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 20/34] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:19 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1273 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:20.975960 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ccadd474-9034-4e2c-b012-8da823bb48bb tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:20.977392 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ccadd474-9034-4e2c-b012-8da823bb48bb tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:21.011103 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ccadd474-9034-4e2c-b012-8da823bb48bb tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:21.011774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ccadd474-9034-4e2c-b012-8da823bb48bb tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:21.012812 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ccadd474-9034-4e2c-b012-8da823bb48bb tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:21.013613 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ccadd474-9034-4e2c-b012-8da823bb48bb tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:21.458703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ccadd474-9034-4e2c-b012-8da823bb48bb tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:21.474487 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ccadd474-9034-4e2c-b012-8da823bb48bb tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1273 microversion: 2.1 time: 0.503011 May 24 15:38:21.480518 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 21/35] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:20 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1273 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:22.038859 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-875711985", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "062393c0-66b9-4ecb-bb43-dbb81b8673fe"}], "security_groups": [{"name": "tempest-securitygroup--1509009074"}], "key_name": "tempest-keypair-255421339", "user_data": "}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:22.604094 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:38:22.604702 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:38:22.605274 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:38:22.605698 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:38:22.606139 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:38:22.663197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:22.670012 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:22.675633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:22.681616 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:22.794035 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Getting quotas for project e280d545f6064b5c91289a77e2491511. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:38:22.820496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Getting quotas for user 6d07884e92bc4cfe95d2fd99c40f25f0 and project e280d545f6064b5c91289a77e2491511. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:38:22.867575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] validate_networks() for [('062393c0-66b9-4ecb-bb43-dbb81b8673fe', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:38:22.872404 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:38:22.877279 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:38:23.008882 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-07446902-5a38-4e81-b925-9bcdeec798b5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.381520 May 24 15:38:23.011732 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 15/36] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:38:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 5385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:38:23.030564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b074d86f-c462-47d5-83c9-30085e6574d7 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:23.031622 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b074d86f-c462-47d5-83c9-30085e6574d7 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:23.051464 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b074d86f-c462-47d5-83c9-30085e6574d7 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:23.060871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b074d86f-c462-47d5-83c9-30085e6574d7 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:23.063418 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b074d86f-c462-47d5-83c9-30085e6574d7 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:23.064226 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b074d86f-c462-47d5-83c9-30085e6574d7 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:23.620460 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b074d86f-c462-47d5-83c9-30085e6574d7 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:23.630096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b074d86f-c462-47d5-83c9-30085e6574d7 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.614992 May 24 15:38:23.632594 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 16/37] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:23 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:23.643314 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2e93dc6a-9cfa-4590-91e4-d86d3610e5ac tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:23.648487 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2e93dc6a-9cfa-4590-91e4-d86d3610e5ac tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:23.826125 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2e93dc6a-9cfa-4590-91e4-d86d3610e5ac tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:23.833501 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2e93dc6a-9cfa-4590-91e4-d86d3610e5ac tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1221 microversion: 2.1 time: 0.199273 May 24 15:38:23.834418 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 17/38] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:23 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1221 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:24.273806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:38:24.274374 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:38:24.274670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:38:24.275975 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:38:24.283377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:38:24.306210 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.307254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.309191 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.310165 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.335242 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Getting quotas for project fd0613f4cbb3461a982738c683c3ab03. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:38:24.358813 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Getting quotas for user 9bb20bf4c31d44ac9dd9ef0db9a2a63a and project fd0613f4cbb3461a982738c683c3ab03. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:38:24.414621 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:38:24.416852 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:38:24.518688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2f9a824a-f64d-4fb4-aa2c-4b6695e8c60d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.486964 May 24 15:38:24.525601 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 22/39] 10.222.0.55 () {62 vars in 1187 bytes} [Tue May 24 15:38:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2495 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 15:38:24.538061 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-84c93125-fc34-4a8d-9888-4f5895036bd2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:24.539263 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-84c93125-fc34-4a8d-9888-4f5895036bd2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:24.649696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-761484f2-348c-4db7-a39c-d4efaa54f082 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:24.651040 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-761484f2-348c-4db7-a39c-d4efaa54f082 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:24.664175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-761484f2-348c-4db7-a39c-d4efaa54f082 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.665192 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-761484f2-348c-4db7-a39c-d4efaa54f082 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.668921 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-761484f2-348c-4db7-a39c-d4efaa54f082 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.670376 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-761484f2-348c-4db7-a39c-d4efaa54f082 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.732958 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-84c93125-fc34-4a8d-9888-4f5895036bd2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:24.772615 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-84c93125-fc34-4a8d-9888-4f5895036bd2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:24.781228 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-84c93125-fc34-4a8d-9888-4f5895036bd2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:24.786194 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-84c93125-fc34-4a8d-9888-4f5895036bd2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1280 microversion: 2.20 time: 0.254301 May 24 15:38:24.795332 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 18/40] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:24 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1280 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:24.852091 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f235e714-e122-4f65-8c24-0af763bf472f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:24.852726 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f235e714-e122-4f65-8c24-0af763bf472f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:24.865623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f235e714-e122-4f65-8c24-0af763bf472f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.866115 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f235e714-e122-4f65-8c24-0af763bf472f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:24.866910 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f235e714-e122-4f65-8c24-0af763bf472f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:24.867349 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f235e714-e122-4f65-8c24-0af763bf472f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.087592 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f235e714-e122-4f65-8c24-0af763bf472f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:25.101943 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f235e714-e122-4f65-8c24-0af763bf472f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1225 microversion: 2.1 time: 0.255061 May 24 15:38:25.104901 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 19/41] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:24 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1225 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:25.305814 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-761484f2-348c-4db7-a39c-d4efaa54f082 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:25.315740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-761484f2-348c-4db7-a39c-d4efaa54f082 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.670754 May 24 15:38:25.316319 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 23/42] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:24 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:25.806514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e1b2d6e5-0053-4c2a-b527-5f7f3887f059 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:25.808047 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e1b2d6e5-0053-4c2a-b527-5f7f3887f059 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:25.819483 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1b2d6e5-0053-4c2a-b527-5f7f3887f059 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:25.820685 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1b2d6e5-0053-4c2a-b527-5f7f3887f059 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.823160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1b2d6e5-0053-4c2a-b527-5f7f3887f059 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:25.824016 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1b2d6e5-0053-4c2a-b527-5f7f3887f059 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:25.997005 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e1b2d6e5-0053-4c2a-b527-5f7f3887f059 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.005958 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e1b2d6e5-0053-4c2a-b527-5f7f3887f059 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.013830 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e1b2d6e5-0053-4c2a-b527-5f7f3887f059 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.018972 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e1b2d6e5-0053-4c2a-b527-5f7f3887f059 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1284 microversion: 2.20 time: 0.214516 May 24 15:38:26.020243 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 20/43] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:25 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:26.128316 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-40591869-5e8e-4142-adcb-82cbcebd8636 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:26.129350 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-40591869-5e8e-4142-adcb-82cbcebd8636 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:26.150314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-40591869-5e8e-4142-adcb-82cbcebd8636 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:26.151956 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-40591869-5e8e-4142-adcb-82cbcebd8636 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:26.157390 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-40591869-5e8e-4142-adcb-82cbcebd8636 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:26.158155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-40591869-5e8e-4142-adcb-82cbcebd8636 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:26.334334 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-69b7328f-fde0-4db0-949c-a53164535f53 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:26.335210 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-69b7328f-fde0-4db0-949c-a53164535f53 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:26.345432 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69b7328f-fde0-4db0-949c-a53164535f53 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:26.346143 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-40591869-5e8e-4142-adcb-82cbcebd8636 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.353535 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69b7328f-fde0-4db0-949c-a53164535f53 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:26.355839 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69b7328f-fde0-4db0-949c-a53164535f53 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:26.357057 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69b7328f-fde0-4db0-949c-a53164535f53 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:26.363140 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-40591869-5e8e-4142-adcb-82cbcebd8636 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1217 microversion: 2.1 time: 0.242873 May 24 15:38:26.374335 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 24/44] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:26 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1217 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:26.777932 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-69b7328f-fde0-4db0-949c-a53164535f53 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:26.793858 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-69b7328f-fde0-4db0-949c-a53164535f53 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.464561 May 24 15:38:26.805558 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 21/45] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:26 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:27.039682 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6ee14845-e06f-4141-8f51-9ed9e5c2338b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:27.040462 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6ee14845-e06f-4141-8f51-9ed9e5c2338b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:27.050217 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6ee14845-e06f-4141-8f51-9ed9e5c2338b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.051801 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6ee14845-e06f-4141-8f51-9ed9e5c2338b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.056197 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6ee14845-e06f-4141-8f51-9ed9e5c2338b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.061276 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6ee14845-e06f-4141-8f51-9ed9e5c2338b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.329797 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6ee14845-e06f-4141-8f51-9ed9e5c2338b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:27.345179 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6ee14845-e06f-4141-8f51-9ed9e5c2338b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:27.349033 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6ee14845-e06f-4141-8f51-9ed9e5c2338b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:27.362233 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6ee14845-e06f-4141-8f51-9ed9e5c2338b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1332 microversion: 2.20 time: 0.325012 May 24 15:38:27.364889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 25/46] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:27 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1332 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:27.381908 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-436db20e-ee57-44d8-9f08-fd1ee2aa381b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:27.383304 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-436db20e-ee57-44d8-9f08-fd1ee2aa381b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:27.397215 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-436db20e-ee57-44d8-9f08-fd1ee2aa381b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.398088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-436db20e-ee57-44d8-9f08-fd1ee2aa381b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.399881 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-436db20e-ee57-44d8-9f08-fd1ee2aa381b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.401860 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-436db20e-ee57-44d8-9f08-fd1ee2aa381b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.563385 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-436db20e-ee57-44d8-9f08-fd1ee2aa381b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:27.574543 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-436db20e-ee57-44d8-9f08-fd1ee2aa381b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1273 microversion: 2.1 time: 0.196987 May 24 15:38:27.575590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 22/47] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:27 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:27.812185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-247fef54-ab8d-4309-8280-e0dd6fca5e1b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:27.812728 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-247fef54-ab8d-4309-8280-e0dd6fca5e1b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:27.825695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-247fef54-ab8d-4309-8280-e0dd6fca5e1b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.827775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-247fef54-ab8d-4309-8280-e0dd6fca5e1b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:27.828910 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-247fef54-ab8d-4309-8280-e0dd6fca5e1b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:27.835321 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-247fef54-ab8d-4309-8280-e0dd6fca5e1b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.314685 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-247fef54-ab8d-4309-8280-e0dd6fca5e1b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:28.332092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-247fef54-ab8d-4309-8280-e0dd6fca5e1b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.516611 May 24 15:38:28.335766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 26/48] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:27 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:28.384558 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c19f062b-3ec5-4ce6-ba87-a613756efd5a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:28.385204 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c19f062b-3ec5-4ce6-ba87-a613756efd5a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:28.400155 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c19f062b-3ec5-4ce6-ba87-a613756efd5a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:28.400611 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c19f062b-3ec5-4ce6-ba87-a613756efd5a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.401402 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c19f062b-3ec5-4ce6-ba87-a613756efd5a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:28.401836 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c19f062b-3ec5-4ce6-ba87-a613756efd5a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.570872 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c19f062b-3ec5-4ce6-ba87-a613756efd5a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:28.581708 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c19f062b-3ec5-4ce6-ba87-a613756efd5a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:28.584800 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c19f062b-3ec5-4ce6-ba87-a613756efd5a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:28.592539 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e2613f01-5d80-401c-a706-d7e653f0f507 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:28.593778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e2613f01-5d80-401c-a706-d7e653f0f507 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:28.599401 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c19f062b-3ec5-4ce6-ba87-a613756efd5a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1332 microversion: 2.20 time: 0.220664 May 24 15:38:28.602032 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 23/49] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:28 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1332 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:28.603543 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e2613f01-5d80-401c-a706-d7e653f0f507 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:28.604188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e2613f01-5d80-401c-a706-d7e653f0f507 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.605130 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e2613f01-5d80-401c-a706-d7e653f0f507 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:28.605796 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e2613f01-5d80-401c-a706-d7e653f0f507 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:28.724287 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e2613f01-5d80-401c-a706-d7e653f0f507 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:28.732531 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e2613f01-5d80-401c-a706-d7e653f0f507 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1273 microversion: 2.1 time: 0.145374 May 24 15:38:28.736351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 27/50] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:28 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:29.349700 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e0a88973-2833-4213-a833-19b3b3d04602 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:29.350311 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e0a88973-2833-4213-a833-19b3b3d04602 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:29.356662 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0a88973-2833-4213-a833-19b3b3d04602 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.356777 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0a88973-2833-4213-a833-19b3b3d04602 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.357442 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0a88973-2833-4213-a833-19b3b3d04602 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.357898 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0a88973-2833-4213-a833-19b3b3d04602 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.486936 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3f247fe6-4b40-4444-ab19-cc4eff62bdb4 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d4d11d30>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:29.561944 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3f247fe6-4b40-4444-ab19-cc4eff62bdb4 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/4a655746-9490-4b3b-aacd-542ac20929d2" status: 200 len: 350 microversion: 2.1 time: 0.080702 May 24 15:38:29.568564 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 28/51] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:38:29 2022] GET /compute/v2.1/os-volumes/4a655746-9490-4b3b-aacd-542ac20929d2 => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:29.594880 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e0a88973-2833-4213-a833-19b3b3d04602 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.603096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e0a88973-2833-4213-a833-19b3b3d04602 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.257215 May 24 15:38:29.603691 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 24/52] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:29 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:29.618913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e853ba26-4e21-42d8-8c45-db79e947d655 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:29.619876 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e853ba26-4e21-42d8-8c45-db79e947d655 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:29.629071 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e853ba26-4e21-42d8-8c45-db79e947d655 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.632808 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e853ba26-4e21-42d8-8c45-db79e947d655 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.635512 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e853ba26-4e21-42d8-8c45-db79e947d655 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.636185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e853ba26-4e21-42d8-8c45-db79e947d655 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.752650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-775a75aa-71cb-4c46-967a-7821659531b4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:29.753479 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-775a75aa-71cb-4c46-967a-7821659531b4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:29.763064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-775a75aa-71cb-4c46-967a-7821659531b4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.765873 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-775a75aa-71cb-4c46-967a-7821659531b4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.766745 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-775a75aa-71cb-4c46-967a-7821659531b4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:29.767419 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-775a75aa-71cb-4c46-967a-7821659531b4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:29.783475 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e853ba26-4e21-42d8-8c45-db79e947d655 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.792842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e853ba26-4e21-42d8-8c45-db79e947d655 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.797690 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e853ba26-4e21-42d8-8c45-db79e947d655 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.800908 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e853ba26-4e21-42d8-8c45-db79e947d655 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1332 microversion: 2.20 time: 0.183930 May 24 15:38:29.825216 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 29/53] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:29 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1332 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:29.885338 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-775a75aa-71cb-4c46-967a-7821659531b4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:29.894931 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-775a75aa-71cb-4c46-967a-7821659531b4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1273 microversion: 2.1 time: 0.146032 May 24 15:38:29.906702 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 25/54] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:29 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:30.622384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6e59d3ce-a444-4455-9c56-43d2b08c8f7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:30.623020 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6e59d3ce-a444-4455-9c56-43d2b08c8f7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:30.641088 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6e59d3ce-a444-4455-9c56-43d2b08c8f7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.641830 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6e59d3ce-a444-4455-9c56-43d2b08c8f7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.642772 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6e59d3ce-a444-4455-9c56-43d2b08c8f7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.643532 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6e59d3ce-a444-4455-9c56-43d2b08c8f7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.841960 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e460ea9a-10b6-4d4f-8e47-a6be0ee8ae98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:30.841960 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e460ea9a-10b6-4d4f-8e47-a6be0ee8ae98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:30.848925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e460ea9a-10b6-4d4f-8e47-a6be0ee8ae98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.849368 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e460ea9a-10b6-4d4f-8e47-a6be0ee8ae98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.850222 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e460ea9a-10b6-4d4f-8e47-a6be0ee8ae98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.850654 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e460ea9a-10b6-4d4f-8e47-a6be0ee8ae98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.858416 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6e59d3ce-a444-4455-9c56-43d2b08c8f7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:30.867554 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6e59d3ce-a444-4455-9c56-43d2b08c8f7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.249086 May 24 15:38:30.881334 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 30/55] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:30 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:30.915668 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-22880a26-bb72-400b-9ec0-f40b4af756e6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:30.916911 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-22880a26-bb72-400b-9ec0-f40b4af756e6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:30.930850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-22880a26-bb72-400b-9ec0-f40b4af756e6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.931292 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-22880a26-bb72-400b-9ec0-f40b4af756e6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.937430 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-22880a26-bb72-400b-9ec0-f40b4af756e6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:30.940131 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-22880a26-bb72-400b-9ec0-f40b4af756e6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:30.968231 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e460ea9a-10b6-4d4f-8e47-a6be0ee8ae98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:30.981383 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e460ea9a-10b6-4d4f-8e47-a6be0ee8ae98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:30.986574 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e460ea9a-10b6-4d4f-8e47-a6be0ee8ae98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:30.989177 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e460ea9a-10b6-4d4f-8e47-a6be0ee8ae98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1332 microversion: 2.20 time: 0.161427 May 24 15:38:30.992987 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 26/56] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:30 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1332 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:31.046066 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-22880a26-bb72-400b-9ec0-f40b4af756e6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:31.053900 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-22880a26-bb72-400b-9ec0-f40b4af756e6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1273 microversion: 2.1 time: 0.144013 May 24 15:38:31.055619 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 31/57] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:30 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:31.157751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-279d7ae0-b08d-4fa4-828a-b23faa4c8100 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d5d58940>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:31.216486 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-279d7ae0-b08d-4fa4-828a-b23faa4c8100 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/bb9399f0-f3fc-46e3-b37f-02775bd407b3" status: 200 len: 350 microversion: 2.1 time: 0.062473 May 24 15:38:31.217348 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 27/58] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:38:31 2022] GET /compute/v2.1/os-volumes/bb9399f0-f3fc-46e3-b37f-02775bd407b3 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:31.909157 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-5b30de02-517a-4354-be5e-c9bbdab6c6aa tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:31.910241 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-5b30de02-517a-4354-be5e-c9bbdab6c6aa tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:31.935359 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5b30de02-517a-4354-be5e-c9bbdab6c6aa tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:31.938976 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5b30de02-517a-4354-be5e-c9bbdab6c6aa tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:31.943392 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5b30de02-517a-4354-be5e-c9bbdab6c6aa tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:31.946635 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5b30de02-517a-4354-be5e-c9bbdab6c6aa tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.013411 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0c0c2b58-7d1f-4c60-8101-44d522322097 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:32.014014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0c0c2b58-7d1f-4c60-8101-44d522322097 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:32.034388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:32.036151 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c0c2b58-7d1f-4c60-8101-44d522322097 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.036601 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c0c2b58-7d1f-4c60-8101-44d522322097 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.037376 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c0c2b58-7d1f-4c60-8101-44d522322097 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.037880 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c0c2b58-7d1f-4c60-8101-44d522322097 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.051583 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=77 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:32.455478 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0c0c2b58-7d1f-4c60-8101-44d522322097 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:32.465758 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0c0c2b58-7d1f-4c60-8101-44d522322097 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:32.467465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0c0c2b58-7d1f-4c60-8101-44d522322097 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:32.468987 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0c0c2b58-7d1f-4c60-8101-44d522322097 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1340 microversion: 2.20 time: 0.459803 May 24 15:38:32.470110 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 28/59] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:32 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1340 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:32.475496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ac073374-98fb-401e-a0c7-f9ee875edac8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:32.476146 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ac073374-98fb-401e-a0c7-f9ee875edac8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:32.483985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ac073374-98fb-401e-a0c7-f9ee875edac8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.484773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ac073374-98fb-401e-a0c7-f9ee875edac8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.485783 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ac073374-98fb-401e-a0c7-f9ee875edac8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:32.486447 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ac073374-98fb-401e-a0c7-f9ee875edac8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:32.649170 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ac073374-98fb-401e-a0c7-f9ee875edac8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:32.658029 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ac073374-98fb-401e-a0c7-f9ee875edac8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1279 microversion: 2.1 time: 0.186723 May 24 15:38:32.658602 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 29/60] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:32 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1279 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:32.663733 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-658b7d25-842e-4ac5-9676-5b9ccb38ce3c tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d5d274c0>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:32.729093 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-658b7d25-842e-4ac5-9676-5b9ccb38ce3c tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/22452d78-975f-4fa1-aa0b-48422980ab45" status: 200 len: 351 microversion: 2.1 time: 0.069121 May 24 15:38:32.730036 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 30/61] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:38:32 2022] GET /compute/v2.1/os-volumes/22452d78-975f-4fa1-aa0b-48422980ab45 => generated 351 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:32.736501 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-5b30de02-517a-4354-be5e-c9bbdab6c6aa tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:32.738234 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=4 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:32.741111 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=87 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:32.742575 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5bf0f0b0-2c4c-4b8a-93ea-0cd3c640da55 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d5d58160>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:32.755000 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-5b30de02-517a-4354-be5e-c9bbdab6c6aa tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.873975 May 24 15:38:32.755951 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 32/62] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:31 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:32.961890 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5bf0f0b0-2c4c-4b8a-93ea-0cd3c640da55 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.224189 May 24 15:38:32.969408 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 31/63] 10.222.0.55 () {58 vars in 1133 bytes} [Tue May 24 15:38:32 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:32.975876 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-208fd1ee-7132-404c-9c4b-fd759b4bb8ab tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d4c61040>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:33.066005 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-208fd1ee-7132-404c-9c4b-fd759b4bb8ab tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094597 May 24 15:38:33.068432 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 33/64] 10.222.0.55 () {58 vars in 1148 bytes} [Tue May 24 15:38:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:33.080855 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-770de22a-67f2-4fac-a822-0896eac9385b tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d5d583a0>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:33.174234 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-770de22a-67f2-4fac-a822-0896eac9385b tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099149 May 24 15:38:33.182743 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 32/65] 10.222.0.55 () {58 vars in 1133 bytes} [Tue May 24 15:38:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:33.186939 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ec6a2c9c-1de1-4c22-9a4a-fb9889cd7cf6 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d4cc7ee0>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:33.307269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ec6a2c9c-1de1-4c22-9a4a-fb9889cd7cf6 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.124419 May 24 15:38:33.308153 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 34/66] 10.222.0.55 () {58 vars in 1166 bytes} [Tue May 24 15:38:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:38:33.320855 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e0e0788a-21c9-4686-9790-6f9d36e53607 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d5d273a0>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:33.489490 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c6a5b0f6-a491-4527-97b4-86ada0272dba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:33.490209 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c6a5b0f6-a491-4527-97b4-86ada0272dba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:33.509966 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:33.510443 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e0e0788a-21c9-4686-9790-6f9d36e53607 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.194604 May 24 15:38:33.520857 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 33/67] 10.222.0.55 () {58 vars in 1169 bytes} [Tue May 24 15:38:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:33.521074 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c6a5b0f6-a491-4527-97b4-86ada0272dba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:33.523544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c6a5b0f6-a491-4527-97b4-86ada0272dba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:33.524582 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c6a5b0f6-a491-4527-97b4-86ada0272dba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:33.526309 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c6a5b0f6-a491-4527-97b4-86ada0272dba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:33.535452 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b4777d9f-e2c0-41f5-a8bc-72551f767aef tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d54f29d0>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:33.674934 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c6a5b0f6-a491-4527-97b4-86ada0272dba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:33.688214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c6a5b0f6-a491-4527-97b4-86ada0272dba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:33.689725 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c6a5b0f6-a491-4527-97b4-86ada0272dba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:33.690837 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c6a5b0f6-a491-4527-97b4-86ada0272dba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1338 microversion: 2.20 time: 0.207157 May 24 15:38:33.716577 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 35/68] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:33 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1338 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:33.724834 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-02a6f0d5-903f-43ab-adfb-d22540730c29 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:33.726261 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-02a6f0d5-903f-43ab-adfb-d22540730c29 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:33.747727 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02a6f0d5-903f-43ab-adfb-d22540730c29 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:33.753297 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02a6f0d5-903f-43ab-adfb-d22540730c29 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:33.762986 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02a6f0d5-903f-43ab-adfb-d22540730c29 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:33.764285 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02a6f0d5-903f-43ab-adfb-d22540730c29 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.195155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-02a6f0d5-903f-43ab-adfb-d22540730c29 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:34.210456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-02a6f0d5-903f-43ab-adfb-d22540730c29 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1279 microversion: 2.1 time: 0.499040 May 24 15:38:34.213375 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 36/69] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:33 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1279 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:34.219861 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ca6517a4-f1f3-4fc1-856d-4bfbb6347ae8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:34.225510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ca6517a4-f1f3-4fc1-856d-4bfbb6347ae8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:34.239016 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca6517a4-f1f3-4fc1-856d-4bfbb6347ae8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.243192 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca6517a4-f1f3-4fc1-856d-4bfbb6347ae8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.244275 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca6517a4-f1f3-4fc1-856d-4bfbb6347ae8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.244862 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca6517a4-f1f3-4fc1-856d-4bfbb6347ae8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.296368 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b4777d9f-e2c0-41f5-a8bc-72551f767aef tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.772054 May 24 15:38:34.296920 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 34/70] 10.222.0.55 () {58 vars in 1154 bytes} [Tue May 24 15:38:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:34.308777 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-12bf7209-0c2b-4884-b193-ac70c79804d2 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d5d58550>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:34.322413 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:34.392091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=18 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:34.444673 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-12bf7209-0c2b-4884-b193-ac70c79804d2 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.140172 May 24 15:38:34.445396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 35/71] 10.222.0.55 () {58 vars in 1187 bytes} [Tue May 24 15:38:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:38:34.460401 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-30d3b1ae-9b50-4d9e-a82a-b1b3fa1b3f86 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] Calling method '.version_select at 0x7fb1d5d58040>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:34.642038 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-30d3b1ae-9b50-4d9e-a82a-b1b3fa1b3f86 tempest-VolumesTestJSON-670725624 tempest-VolumesTestJSON-670725624-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.187293 May 24 15:38:34.652440 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 36/72] 10.222.0.55 () {58 vars in 1154 bytes} [Tue May 24 15:38:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:34.726054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-afaaa312-89f7-41fa-99e6-770641b2d610 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:34.726657 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-afaaa312-89f7-41fa-99e6-770641b2d610 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:34.748367 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-afaaa312-89f7-41fa-99e6-770641b2d610 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.748833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-afaaa312-89f7-41fa-99e6-770641b2d610 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.749625 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-afaaa312-89f7-41fa-99e6-770641b2d610 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:34.750069 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-afaaa312-89f7-41fa-99e6-770641b2d610 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:34.790749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=20 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:34.968742 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ca6517a4-f1f3-4fc1-856d-4bfbb6347ae8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:34.980397 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ca6517a4-f1f3-4fc1-856d-4bfbb6347ae8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.762643 May 24 15:38:34.981035 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 37/73] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:34 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:34.990693 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-afaaa312-89f7-41fa-99e6-770641b2d610 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:35.001263 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-afaaa312-89f7-41fa-99e6-770641b2d610 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:35.002852 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-afaaa312-89f7-41fa-99e6-770641b2d610 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:35.007892 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-afaaa312-89f7-41fa-99e6-770641b2d610 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1338 microversion: 2.20 time: 0.285733 May 24 15:38:35.016171 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 37/74] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:34 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1338 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:35.229151 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bcf4b4df-28c7-4f03-92fc-3e496049e8aa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:35.230043 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bcf4b4df-28c7-4f03-92fc-3e496049e8aa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:35.243551 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bcf4b4df-28c7-4f03-92fc-3e496049e8aa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:35.243908 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bcf4b4df-28c7-4f03-92fc-3e496049e8aa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.244708 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bcf4b4df-28c7-4f03-92fc-3e496049e8aa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:35.245556 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bcf4b4df-28c7-4f03-92fc-3e496049e8aa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.304215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-b8da963d-01bb-43f6-a95d-c32f6862a0c8 req-62de1f5f-0192-4004-99c0-d550ec9d74de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baac3150-841e-41d4-8408-93df2ec929c9", "tag": "96344a89-ed01-4bee-abb4-d0e1e6ef0c96"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:35.328842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-b8da963d-01bb-43f6-a95d-c32f6862a0c8 req-62de1f5f-0192-4004-99c0-d550ec9d74de service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:35.343007 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-b8da963d-01bb-43f6-a95d-c32f6862a0c8 req-62de1f5f-0192-4004-99c0-d550ec9d74de service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.386149 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-b8da963d-01bb-43f6-a95d-c32f6862a0c8 req-62de1f5f-0192-4004-99c0-d550ec9d74de service nova] Creating event network-changed:96344a89-ed01-4bee-abb4-d0e1e6ef0c96 for instance baac3150-841e-41d4-8408-93df2ec929c9 on hv-cinder-84315 May 24 15:38:35.387587 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-b8da963d-01bb-43f6-a95d-c32f6862a0c8 req-62de1f5f-0192-4004-99c0-d550ec9d74de service nova] Acquired lock "compute-rpcapi-router" {{(pid=129340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 24 15:38:35.388968 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-739c47c7-fe75-43d2-9c0f-21ea9f799528 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:35.390573 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-739c47c7-fe75-43d2-9c0f-21ea9f799528 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.394813 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-739c47c7-fe75-43d2-9c0f-21ea9f799528 None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:35.395511 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-739c47c7-fe75-43d2-9c0f-21ea9f799528 None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.413020 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.compute.rpcapi [None req-739c47c7-fe75-43d2-9c0f-21ea9f799528 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 24 15:38:35.416071 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-739c47c7-fe75-43d2-9c0f-21ea9f799528 None None] Releasing lock "compute-rpcapi-router" {{(pid=129340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 24 15:38:35.450004 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-739c47c7-fe75-43d2-9c0f-21ea9f799528 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.467624 May 24 15:38:35.451099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 38/75] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:35.572239 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-d7f3609b-506c-47f3-a3e1-f7974a1c8f8f req-5c2963ca-c324-4334-98d0-74c05712e593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69fdd945-52b6-4e16-9cd0-06bf19fc5536", "tag": "110b6658-6aab-4863-9381-91ebcbd0ce77"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:35.588686 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-d7f3609b-506c-47f3-a3e1-f7974a1c8f8f req-5c2963ca-c324-4334-98d0-74c05712e593 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:35.593975 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-d7f3609b-506c-47f3-a3e1-f7974a1c8f8f req-5c2963ca-c324-4334-98d0-74c05712e593 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:35.619945 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-d7f3609b-506c-47f3-a3e1-f7974a1c8f8f req-5c2963ca-c324-4334-98d0-74c05712e593 service nova] Creating event network-changed:110b6658-6aab-4863-9381-91ebcbd0ce77 for instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 on hv-cinder-84315 May 24 15:38:35.630881 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-d7f3609b-506c-47f3-a3e1-f7974a1c8f8f req-5c2963ca-c324-4334-98d0-74c05712e593 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177862 May 24 15:38:35.633208 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 39/76] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:35.946140 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bcf4b4df-28c7-4f03-92fc-3e496049e8aa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:35.958192 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bcf4b4df-28c7-4f03-92fc-3e496049e8aa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.731885 May 24 15:38:35.961424 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 38/77] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:35 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:36.000397 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-81e6528a-522e-4ce4-8237-56ae8141c355 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:36.001221 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-81e6528a-522e-4ce4-8237-56ae8141c355 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:36.010971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-81e6528a-522e-4ce4-8237-56ae8141c355 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.011708 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-81e6528a-522e-4ce4-8237-56ae8141c355 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.014115 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-81e6528a-522e-4ce4-8237-56ae8141c355 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.014845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-81e6528a-522e-4ce4-8237-56ae8141c355 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.026675 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-932cd848-ed7b-4417-b9aa-41a1b5835d63 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:36.027642 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-932cd848-ed7b-4417-b9aa-41a1b5835d63 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:36.037684 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-932cd848-ed7b-4417-b9aa-41a1b5835d63 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.039359 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-932cd848-ed7b-4417-b9aa-41a1b5835d63 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.043216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-932cd848-ed7b-4417-b9aa-41a1b5835d63 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.043893 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-932cd848-ed7b-4417-b9aa-41a1b5835d63 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.595215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-81e6528a-522e-4ce4-8237-56ae8141c355 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:36.608803 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-81e6528a-522e-4ce4-8237-56ae8141c355 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.608569 May 24 15:38:36.609510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 40/78] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:35 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:36.635114 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-932cd848-ed7b-4417-b9aa-41a1b5835d63 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:36.657218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-932cd848-ed7b-4417-b9aa-41a1b5835d63 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:36.659816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-932cd848-ed7b-4417-b9aa-41a1b5835d63 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:36.662073 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-932cd848-ed7b-4417-b9aa-41a1b5835d63 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.639394 May 24 15:38:36.687340 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 39/79] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:36 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:36.978422 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-56f01611-7b82-4da2-9193-1d84a6ca9b56 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:36.979161 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-56f01611-7b82-4da2-9193-1d84a6ca9b56 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:36.987492 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-56f01611-7b82-4da2-9193-1d84a6ca9b56 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.987949 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-56f01611-7b82-4da2-9193-1d84a6ca9b56 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:36.991868 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-56f01611-7b82-4da2-9193-1d84a6ca9b56 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:36.996326 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-56f01611-7b82-4da2-9193-1d84a6ca9b56 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.428349 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-56f01611-7b82-4da2-9193-1d84a6ca9b56 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:37.446878 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-56f01611-7b82-4da2-9193-1d84a6ca9b56 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.471217 May 24 15:38:37.448266 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 41/80] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:36 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:37.594328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-c20166eb-7db8-4e6b-87f0-1a36a7fbbfce req-7166f961-d149-41c5-990a-b29baa6c660c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d791b8-2dce-43c8-9faa-5af5f5e14d65", "tag": "e827b410-d904-420a-8600-036fec1a80f7"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:37.621562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-c20166eb-7db8-4e6b-87f0-1a36a7fbbfce req-7166f961-d149-41c5-990a-b29baa6c660c service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.622196 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-c20166eb-7db8-4e6b-87f0-1a36a7fbbfce req-7166f961-d149-41c5-990a-b29baa6c660c service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.628767 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ebd0f047-5a70-40bd-a10e-4554252cbc46 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:37.629507 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ebd0f047-5a70-40bd-a10e-4554252cbc46 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:37.656377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ebd0f047-5a70-40bd-a10e-4554252cbc46 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.657258 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ebd0f047-5a70-40bd-a10e-4554252cbc46 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.658372 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ebd0f047-5a70-40bd-a10e-4554252cbc46 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.658962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ebd0f047-5a70-40bd-a10e-4554252cbc46 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.697620 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-c20166eb-7db8-4e6b-87f0-1a36a7fbbfce req-7166f961-d149-41c5-990a-b29baa6c660c service nova] Creating event network-changed:e827b410-d904-420a-8600-036fec1a80f7 for instance 84d791b8-2dce-43c8-9faa-5af5f5e14d65 on hv-cinder-84315 May 24 15:38:37.705209 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-c20166eb-7db8-4e6b-87f0-1a36a7fbbfce req-7166f961-d149-41c5-990a-b29baa6c660c service nova] Acquired lock "compute-rpcapi-router" {{(pid=129339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 24 15:38:37.707717 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-039ddd16-f1ee-4d50-b606-b9214fdabe2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.709452 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-039ddd16-f1ee-4d50-b606-b9214fdabe2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.713656 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-039ddd16-f1ee-4d50-b606-b9214fdabe2d None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.715399 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-039ddd16-f1ee-4d50-b606-b9214fdabe2d None None] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.736702 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.compute.rpcapi [None req-039ddd16-f1ee-4d50-b606-b9214fdabe2d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 24 15:38:37.738178 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-039ddd16-f1ee-4d50-b606-b9214fdabe2d None None] Releasing lock "compute-rpcapi-router" {{(pid=129339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 24 15:38:37.774637 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-039ddd16-f1ee-4d50-b606-b9214fdabe2d None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184177 May 24 15:38:37.775672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 40/81] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:38:37.783361 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9a7ab3f5-33ff-4ad5-83cd-8dcb5eedc5c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:37.784450 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9a7ab3f5-33ff-4ad5-83cd-8dcb5eedc5c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:37.791499 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a7ab3f5-33ff-4ad5-83cd-8dcb5eedc5c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.793047 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a7ab3f5-33ff-4ad5-83cd-8dcb5eedc5c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:37.795098 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a7ab3f5-33ff-4ad5-83cd-8dcb5eedc5c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:37.795982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a7ab3f5-33ff-4ad5-83cd-8dcb5eedc5c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.009189 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ebd0f047-5a70-40bd-a10e-4554252cbc46 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:38.018668 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ebd0f047-5a70-40bd-a10e-4554252cbc46 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.395756 May 24 15:38:38.028997 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 42/82] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:37 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:38.120979 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-fb2dd262-85ab-43f1-ae09-555c617687a9 req-699169fd-997d-4dfd-9488-cb0d4c4a3e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2694ac-4a5e-4cfa-aaf8-877c8285148a", "tag": "b4136280-42c5-46f1-8248-0dcb997d0277"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:38.140637 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-fb2dd262-85ab-43f1-ae09-555c617687a9 req-699169fd-997d-4dfd-9488-cb0d4c4a3e5e service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.141664 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-fb2dd262-85ab-43f1-ae09-555c617687a9 req-699169fd-997d-4dfd-9488-cb0d4c4a3e5e service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.158567 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-fb2dd262-85ab-43f1-ae09-555c617687a9 req-699169fd-997d-4dfd-9488-cb0d4c4a3e5e service nova] Creating event network-changed:b4136280-42c5-46f1-8248-0dcb997d0277 for instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a on hv-cinder-84315 May 24 15:38:38.164149 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-fb2dd262-85ab-43f1-ae09-555c617687a9 req-699169fd-997d-4dfd-9488-cb0d4c4a3e5e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052609 May 24 15:38:38.165263 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 43/83] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:38.166321 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9a7ab3f5-33ff-4ad5-83cd-8dcb5eedc5c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:38.176345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9a7ab3f5-33ff-4ad5-83cd-8dcb5eedc5c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:38.177921 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9a7ab3f5-33ff-4ad5-83cd-8dcb5eedc5c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:38.179478 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9a7ab3f5-33ff-4ad5-83cd-8dcb5eedc5c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.402571 May 24 15:38:38.180448 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 41/84] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:37 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:38.466010 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2e36c67e-55dc-4515-b32f-6f0e96ad01d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:38.466731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2e36c67e-55dc-4515-b32f-6f0e96ad01d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:38.474686 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2e36c67e-55dc-4515-b32f-6f0e96ad01d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.476104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2e36c67e-55dc-4515-b32f-6f0e96ad01d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.478388 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2e36c67e-55dc-4515-b32f-6f0e96ad01d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:38.479778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2e36c67e-55dc-4515-b32f-6f0e96ad01d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:38.803114 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2e36c67e-55dc-4515-b32f-6f0e96ad01d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:38.812737 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2e36c67e-55dc-4515-b32f-6f0e96ad01d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.351482 May 24 15:38:38.813313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 44/85] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:38 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:39.039269 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7e07d8be-da8b-40a1-95d1-99bc81b838d6 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:39.040582 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7e07d8be-da8b-40a1-95d1-99bc81b838d6 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:39.048475 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7e07d8be-da8b-40a1-95d1-99bc81b838d6 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.049995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7e07d8be-da8b-40a1-95d1-99bc81b838d6 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.051478 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7e07d8be-da8b-40a1-95d1-99bc81b838d6 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.052083 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7e07d8be-da8b-40a1-95d1-99bc81b838d6 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.200417 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fc2355ff-be6f-40c5-a098-7534d536ac27 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:39.201258 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fc2355ff-be6f-40c5-a098-7534d536ac27 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:39.209626 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fc2355ff-be6f-40c5-a098-7534d536ac27 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.211229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fc2355ff-be6f-40c5-a098-7534d536ac27 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.212595 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fc2355ff-be6f-40c5-a098-7534d536ac27 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.213307 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fc2355ff-be6f-40c5-a098-7534d536ac27 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.748422 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7e07d8be-da8b-40a1-95d1-99bc81b838d6 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:39.760962 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7e07d8be-da8b-40a1-95d1-99bc81b838d6 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.728645 May 24 15:38:39.762057 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 42/86] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:39 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:39.786659 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fc2355ff-be6f-40c5-a098-7534d536ac27 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:39.819258 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fc2355ff-be6f-40c5-a098-7534d536ac27 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:39.821021 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fc2355ff-be6f-40c5-a098-7534d536ac27 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:39.822164 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fc2355ff-be6f-40c5-a098-7534d536ac27 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.628225 May 24 15:38:39.822704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 45/87] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:39 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:39.837491 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a5291b74-09a1-4d91-9021-ff40ede013a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:39.838107 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a5291b74-09a1-4d91-9021-ff40ede013a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:39.862383 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a5291b74-09a1-4d91-9021-ff40ede013a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.862832 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a5291b74-09a1-4d91-9021-ff40ede013a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:39.866944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a5291b74-09a1-4d91-9021-ff40ede013a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:39.867420 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a5291b74-09a1-4d91-9021-ff40ede013a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.349608 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a5291b74-09a1-4d91-9021-ff40ede013a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:40.358489 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a5291b74-09a1-4d91-9021-ff40ede013a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.525099 May 24 15:38:40.368277 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 43/88] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:39 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:40.779408 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6bc73659-04be-4157-88dc-6fc963bba70e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:40.780390 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6bc73659-04be-4157-88dc-6fc963bba70e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:40.802345 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6bc73659-04be-4157-88dc-6fc963bba70e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.803525 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6bc73659-04be-4157-88dc-6fc963bba70e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.805372 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6bc73659-04be-4157-88dc-6fc963bba70e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.807094 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6bc73659-04be-4157-88dc-6fc963bba70e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.843377 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a8414800-ddd9-42ad-a12d-a50d69a33c61 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:40.843977 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a8414800-ddd9-42ad-a12d-a50d69a33c61 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:40.856694 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8414800-ddd9-42ad-a12d-a50d69a33c61 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.857653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8414800-ddd9-42ad-a12d-a50d69a33c61 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:40.858606 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8414800-ddd9-42ad-a12d-a50d69a33c61 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:40.859843 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8414800-ddd9-42ad-a12d-a50d69a33c61 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:41.289804 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6bc73659-04be-4157-88dc-6fc963bba70e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:41.291587 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a8414800-ddd9-42ad-a12d-a50d69a33c61 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:41.336665 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6bc73659-04be-4157-88dc-6fc963bba70e tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.561757 May 24 15:38:41.342401 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a8414800-ddd9-42ad-a12d-a50d69a33c61 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:41.353868 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 46/89] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:40 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:41.361171 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a8414800-ddd9-42ad-a12d-a50d69a33c61 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:41.370933 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a8414800-ddd9-42ad-a12d-a50d69a33c61 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.529791 May 24 15:38:41.385056 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 44/90] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:40 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:41.388042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1630206182", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "networks": [{"uuid": "0bcc5330-fb8d-4ac5-8c91-fc8cafd86886"}]}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:41.398165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-21dd81f2-37d1-4cf3-b71c-d143e596b29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:41.400786 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-21dd81f2-37d1-4cf3-b71c-d143e596b29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:41.423448 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-21dd81f2-37d1-4cf3-b71c-d143e596b29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:41.427610 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-21dd81f2-37d1-4cf3-b71c-d143e596b29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:41.434391 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-21dd81f2-37d1-4cf3-b71c-d143e596b29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:41.436636 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-21dd81f2-37d1-4cf3-b71c-d143e596b29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:41.461601 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] validate_networks() for [('0bcc5330-fb8d-4ac5-8c91-fc8cafd86886', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:38:41.881441 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-21dd81f2-37d1-4cf3-b71c-d143e596b29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:41.889849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-21dd81f2-37d1-4cf3-b71c-d143e596b29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.501829 May 24 15:38:41.900901 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 45/91] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:41 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:42.234376 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:38:42.235391 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:38:42.235867 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:38:42.236322 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:38:42.236727 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:38:42.245856 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.246367 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.247118 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.247866 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.267412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Getting quotas for project 80a3c5535f9040e58e055a7277514da1. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:38:42.271957 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Getting quotas for user 0f0285314f124d228986e7f638833d04 and project 80a3c5535f9040e58e055a7277514da1. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:38:42.284639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:38:42.287301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:38:42.344171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b7341fe9-5a7f-4313-ac40-8a6213914184 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988622 May 24 15:38:42.345132 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 47/92] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:38:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:38:42.358835 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b2b68145-035b-4e3a-bdb9-8eea5183e44b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:42.359731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b2b68145-035b-4e3a-bdb9-8eea5183e44b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:42.437844 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b2b68145-035b-4e3a-bdb9-8eea5183e44b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:42.457941 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b2b68145-035b-4e3a-bdb9-8eea5183e44b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1214 microversion: 2.1 time: 0.106040 May 24 15:38:42.469557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 48/93] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:42 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:42.486493 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3ea40fe9-00ae-4f35-be07-9d91c213133b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:42.493282 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-c00ac48b-8669-46aa-8ba8-acce7186e758 req-f40a9b0c-41ff-4302-9070-3d839879ebbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baac3150-841e-41d4-8408-93df2ec929c9", "name": "network-vif-plugged", "status": "completed", "tag": "96344a89-ed01-4bee-abb4-d0e1e6ef0c96"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:42.499280 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3ea40fe9-00ae-4f35-be07-9d91c213133b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:42.514288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-c00ac48b-8669-46aa-8ba8-acce7186e758 req-f40a9b0c-41ff-4302-9070-3d839879ebbb service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.515328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-c00ac48b-8669-46aa-8ba8-acce7186e758 req-f40a9b0c-41ff-4302-9070-3d839879ebbb service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.518639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3ea40fe9-00ae-4f35-be07-9d91c213133b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.519235 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3ea40fe9-00ae-4f35-be07-9d91c213133b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.520322 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3ea40fe9-00ae-4f35-be07-9d91c213133b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.520859 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3ea40fe9-00ae-4f35-be07-9d91c213133b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.536188 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-c00ac48b-8669-46aa-8ba8-acce7186e758 req-f40a9b0c-41ff-4302-9070-3d839879ebbb service nova] Creating event network-vif-plugged:96344a89-ed01-4bee-abb4-d0e1e6ef0c96 for instance baac3150-841e-41d4-8408-93df2ec929c9 on hv-cinder-84315 May 24 15:38:42.551479 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-c00ac48b-8669-46aa-8ba8-acce7186e758 req-f40a9b0c-41ff-4302-9070-3d839879ebbb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.414952 May 24 15:38:42.555622 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 46/94] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:38:42.570589 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a30b16a5-0c70-431b-b14b-b80e6597d7b2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:42.571851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a30b16a5-0c70-431b-b14b-b80e6597d7b2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:42.579944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a30b16a5-0c70-431b-b14b-b80e6597d7b2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.580379 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a30b16a5-0c70-431b-b14b-b80e6597d7b2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.585490 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a30b16a5-0c70-431b-b14b-b80e6597d7b2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.586663 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a30b16a5-0c70-431b-b14b-b80e6597d7b2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.783448 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a30b16a5-0c70-431b-b14b-b80e6597d7b2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:42.794875 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a30b16a5-0c70-431b-b14b-b80e6597d7b2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:42.796455 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a30b16a5-0c70-431b-b14b-b80e6597d7b2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:42.797225 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3ea40fe9-00ae-4f35-be07-9d91c213133b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:42.797585 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a30b16a5-0c70-431b-b14b-b80e6597d7b2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.240612 May 24 15:38:42.798151 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 47/95] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:42 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:42.807119 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3ea40fe9-00ae-4f35-be07-9d91c213133b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.336337 May 24 15:38:42.811644 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 49/96] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:42 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:42.916957 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f46c6472-9618-4a47-8528-3c97b9784564 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:42.917826 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f46c6472-9618-4a47-8528-3c97b9784564 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:42.924081 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f46c6472-9618-4a47-8528-3c97b9784564 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.924653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f46c6472-9618-4a47-8528-3c97b9784564 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:42.926266 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f46c6472-9618-4a47-8528-3c97b9784564 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:42.926689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f46c6472-9618-4a47-8528-3c97b9784564 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.063190 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f46c6472-9618-4a47-8528-3c97b9784564 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:43.070635 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f46c6472-9618-4a47-8528-3c97b9784564 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.157668 May 24 15:38:43.080204 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 48/97] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:42 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:43.482459 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d17ceb95-9cf1-47f5-b3ad-b87502e2d726 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:43.483072 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d17ceb95-9cf1-47f5-b3ad-b87502e2d726 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:43.489950 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d17ceb95-9cf1-47f5-b3ad-b87502e2d726 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.490490 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d17ceb95-9cf1-47f5-b3ad-b87502e2d726 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.491155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d17ceb95-9cf1-47f5-b3ad-b87502e2d726 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.491738 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d17ceb95-9cf1-47f5-b3ad-b87502e2d726 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.562005 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d17ceb95-9cf1-47f5-b3ad-b87502e2d726 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:43.571512 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d17ceb95-9cf1-47f5-b3ad-b87502e2d726 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1218 microversion: 2.1 time: 0.093559 May 24 15:38:43.572114 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 50/98] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:43 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:43.818203 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5ff05ecc-e647-4408-a0f3-2df3f11487c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:43.818951 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5ff05ecc-e647-4408-a0f3-2df3f11487c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:43.826804 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5ff05ecc-e647-4408-a0f3-2df3f11487c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.827514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5ff05ecc-e647-4408-a0f3-2df3f11487c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.827917 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b2731932-96fb-4118-982c-f763db65b017 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:43.828545 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b2731932-96fb-4118-982c-f763db65b017 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:43.829904 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5ff05ecc-e647-4408-a0f3-2df3f11487c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.830593 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5ff05ecc-e647-4408-a0f3-2df3f11487c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.848377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b2731932-96fb-4118-982c-f763db65b017 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.848377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b2731932-96fb-4118-982c-f763db65b017 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:43.848377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b2731932-96fb-4118-982c-f763db65b017 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:43.848377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b2731932-96fb-4118-982c-f763db65b017 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.123866 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5ff05ecc-e647-4408-a0f3-2df3f11487c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.129265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b2731932-96fb-4118-982c-f763db65b017 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.134025 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5ff05ecc-e647-4408-a0f3-2df3f11487c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.136458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5ff05ecc-e647-4408-a0f3-2df3f11487c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.137936 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5ff05ecc-e647-4408-a0f3-2df3f11487c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.324526 May 24 15:38:44.139058 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 49/99] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:43 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:44.149399 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b2731932-96fb-4118-982c-f763db65b017 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.318210 May 24 15:38:44.149399 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 51/100] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:43 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:44.157977 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-55e7a872-7449-4645-b1c4-63ffcdf39543 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:44.158592 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-55e7a872-7449-4645-b1c4-63ffcdf39543 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:44.164997 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-55e7a872-7449-4645-b1c4-63ffcdf39543 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:44.165502 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-55e7a872-7449-4645-b1c4-63ffcdf39543 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.166289 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-55e7a872-7449-4645-b1c4-63ffcdf39543 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:44.166708 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-55e7a872-7449-4645-b1c4-63ffcdf39543 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.324256 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-55e7a872-7449-4645-b1c4-63ffcdf39543 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.332302 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-55e7a872-7449-4645-b1c4-63ffcdf39543 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.178628 May 24 15:38:44.332866 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 52/101] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:44 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:44.589551 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1651b4a2-c914-4212-988b-947c5a2acb1e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:44.590159 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1651b4a2-c914-4212-988b-947c5a2acb1e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:44.597074 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1651b4a2-c914-4212-988b-947c5a2acb1e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:44.597626 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1651b4a2-c914-4212-988b-947c5a2acb1e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.598493 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1651b4a2-c914-4212-988b-947c5a2acb1e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:44.599112 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1651b4a2-c914-4212-988b-947c5a2acb1e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:44.681471 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1651b4a2-c914-4212-988b-947c5a2acb1e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:44.694873 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1651b4a2-c914-4212-988b-947c5a2acb1e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1218 microversion: 2.1 time: 0.109750 May 24 15:38:44.695672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 50/102] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:44 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:45.163960 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-99e4c37a-7049-41ba-a150-70ae567c002f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:45.164918 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-8489b1d8-58f4-450e-926b-b4d1e9628034 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:45.165709 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-99e4c37a-7049-41ba-a150-70ae567c002f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:45.166949 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8489b1d8-58f4-450e-926b-b4d1e9628034 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:45.179763 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8489b1d8-58f4-450e-926b-b4d1e9628034 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.180300 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-99e4c37a-7049-41ba-a150-70ae567c002f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.180756 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-99e4c37a-7049-41ba-a150-70ae567c002f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.181206 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8489b1d8-58f4-450e-926b-b4d1e9628034 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.181977 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8489b1d8-58f4-450e-926b-b4d1e9628034 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.183203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-99e4c37a-7049-41ba-a150-70ae567c002f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.183790 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8489b1d8-58f4-450e-926b-b4d1e9628034 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.184393 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-99e4c37a-7049-41ba-a150-70ae567c002f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.440929 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-99e4c37a-7049-41ba-a150-70ae567c002f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.451362 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-99e4c37a-7049-41ba-a150-70ae567c002f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.454694 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-99e4c37a-7049-41ba-a150-70ae567c002f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.456318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-99e4c37a-7049-41ba-a150-70ae567c002f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.302802 May 24 15:38:45.458991 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8489b1d8-58f4-450e-926b-b4d1e9628034 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.459357 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 53/103] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:45 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:45.465501 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d6c0feee-42f0-44ba-9b3c-c9f37f2790b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:45.466644 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d6c0feee-42f0-44ba-9b3c-c9f37f2790b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:45.469386 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-8489b1d8-58f4-450e-926b-b4d1e9628034 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.314214 May 24 15:38:45.470042 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 51/104] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:45 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:45.474423 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6c0feee-42f0-44ba-9b3c-c9f37f2790b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.475695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6c0feee-42f0-44ba-9b3c-c9f37f2790b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.477160 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6c0feee-42f0-44ba-9b3c-c9f37f2790b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.477813 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6c0feee-42f0-44ba-9b3c-c9f37f2790b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.643204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d6c0feee-42f0-44ba-9b3c-c9f37f2790b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.661933 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=100 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:45.666406 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d6c0feee-42f0-44ba-9b3c-c9f37f2790b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.205782 May 24 15:38:45.667313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 54/105] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:45 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:45.714740 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7b42fd63-a938-408b-929f-feccd5dedc33 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:45.715345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7b42fd63-a938-408b-929f-feccd5dedc33 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:45.721359 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b42fd63-a938-408b-929f-feccd5dedc33 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.721809 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b42fd63-a938-408b-929f-feccd5dedc33 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.722625 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b42fd63-a938-408b-929f-feccd5dedc33 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:45.723298 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b42fd63-a938-408b-929f-feccd5dedc33 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:45.786679 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7b42fd63-a938-408b-929f-feccd5dedc33 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:45.789380 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=100 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:45.797950 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7b42fd63-a938-408b-929f-feccd5dedc33 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1218 microversion: 2.1 time: 0.086973 May 24 15:38:45.798563 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 52/106] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:45 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:46.475199 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fa4cf5a7-842d-4b9d-908f-5e1e35cd7216 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:46.477288 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fa4cf5a7-842d-4b9d-908f-5e1e35cd7216 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:46.485398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fa4cf5a7-842d-4b9d-908f-5e1e35cd7216 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.486338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fa4cf5a7-842d-4b9d-908f-5e1e35cd7216 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.487063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5eca9ac6-2b0d-4cbf-bea6-ff9679a01710 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:46.488167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fa4cf5a7-842d-4b9d-908f-5e1e35cd7216 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.488489 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5eca9ac6-2b0d-4cbf-bea6-ff9679a01710 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:46.489199 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fa4cf5a7-842d-4b9d-908f-5e1e35cd7216 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.495473 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5eca9ac6-2b0d-4cbf-bea6-ff9679a01710 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.495991 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5eca9ac6-2b0d-4cbf-bea6-ff9679a01710 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.496952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5eca9ac6-2b0d-4cbf-bea6-ff9679a01710 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.497511 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5eca9ac6-2b0d-4cbf-bea6-ff9679a01710 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.694505 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fa4cf5a7-842d-4b9d-908f-5e1e35cd7216 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.704333 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fa4cf5a7-842d-4b9d-908f-5e1e35cd7216 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.706030 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fa4cf5a7-842d-4b9d-908f-5e1e35cd7216 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.707926 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fa4cf5a7-842d-4b9d-908f-5e1e35cd7216 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.236476 May 24 15:38:46.719208 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 55/107] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:46 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:46.720447 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5eca9ac6-2b0d-4cbf-bea6-ff9679a01710 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.725478 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2f0b7c43-162f-45e4-aaa4-477431a840fb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:46.726636 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2f0b7c43-162f-45e4-aaa4-477431a840fb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:46.733469 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f0b7c43-162f-45e4-aaa4-477431a840fb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.733851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5eca9ac6-2b0d-4cbf-bea6-ff9679a01710 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.250839 May 24 15:38:46.734435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f0b7c43-162f-45e4-aaa4-477431a840fb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.734548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 53/108] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:46 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:46.735656 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f0b7c43-162f-45e4-aaa4-477431a840fb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.736218 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f0b7c43-162f-45e4-aaa4-477431a840fb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.814545 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-07393f36-df48-444e-9d94-bb1a124d6529 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:46.815568 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-07393f36-df48-444e-9d94-bb1a124d6529 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:46.822329 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07393f36-df48-444e-9d94-bb1a124d6529 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.822967 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07393f36-df48-444e-9d94-bb1a124d6529 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.823880 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07393f36-df48-444e-9d94-bb1a124d6529 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:46.824510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07393f36-df48-444e-9d94-bb1a124d6529 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:46.896200 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-07393f36-df48-444e-9d94-bb1a124d6529 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.904097 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-07393f36-df48-444e-9d94-bb1a124d6529 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1218 microversion: 2.1 time: 0.093215 May 24 15:38:46.904557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 54/109] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:46 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:46.913552 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2f0b7c43-162f-45e4-aaa4-477431a840fb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:46.920221 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2f0b7c43-162f-45e4-aaa4-477431a840fb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.199376 May 24 15:38:46.920795 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 56/110] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:46 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:47.727644 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0a2e198f-4624-4df7-b8e9-c8e3fbc0a549 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:47.728276 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0a2e198f-4624-4df7-b8e9-c8e3fbc0a549 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:47.734537 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0a2e198f-4624-4df7-b8e9-c8e3fbc0a549 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.734984 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0a2e198f-4624-4df7-b8e9-c8e3fbc0a549 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.735741 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0a2e198f-4624-4df7-b8e9-c8e3fbc0a549 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.736211 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0a2e198f-4624-4df7-b8e9-c8e3fbc0a549 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.736630 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:47.750775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-966a8f1d-f391-4ccc-9198-8f2b2924107a tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:47.751935 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-966a8f1d-f391-4ccc-9198-8f2b2924107a tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:47.759818 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-966a8f1d-f391-4ccc-9198-8f2b2924107a tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.760301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-966a8f1d-f391-4ccc-9198-8f2b2924107a tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.761080 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-966a8f1d-f391-4ccc-9198-8f2b2924107a tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.761514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-966a8f1d-f391-4ccc-9198-8f2b2924107a tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.939931 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0a2e198f-4624-4df7-b8e9-c8e3fbc0a549 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:47.943453 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-966a8f1d-f391-4ccc-9198-8f2b2924107a tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:47.948435 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0a2e198f-4624-4df7-b8e9-c8e3fbc0a549 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:47.950179 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0a2e198f-4624-4df7-b8e9-c8e3fbc0a549 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:47.950989 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-966a8f1d-f391-4ccc-9198-8f2b2924107a tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.204162 May 24 15:38:47.951349 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0a2e198f-4624-4df7-b8e9-c8e3fbc0a549 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.229060 May 24 15:38:47.951972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 57/111] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:47 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:47.956477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6de2bbc8-64db-4a1f-abad-f298821ab84f tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:47.957131 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6de2bbc8-64db-4a1f-abad-f298821ab84f tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:47.957759 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 55/112] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:47 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:47.963051 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6de2bbc8-64db-4a1f-abad-f298821ab84f tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.963488 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6de2bbc8-64db-4a1f-abad-f298821ab84f tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.964352 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6de2bbc8-64db-4a1f-abad-f298821ab84f tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.964772 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6de2bbc8-64db-4a1f-abad-f298821ab84f tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.965175 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9dba5caf-7f49-448c-a555-0f491f8f055a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:47.965779 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9dba5caf-7f49-448c-a555-0f491f8f055a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:47.972228 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9dba5caf-7f49-448c-a555-0f491f8f055a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.972806 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9dba5caf-7f49-448c-a555-0f491f8f055a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:47.973571 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9dba5caf-7f49-448c-a555-0f491f8f055a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:47.973998 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9dba5caf-7f49-448c-a555-0f491f8f055a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.038561 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6de2bbc8-64db-4a1f-abad-f298821ab84f tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:48.046631 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6de2bbc8-64db-4a1f-abad-f298821ab84f tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1266 microversion: 2.1 time: 0.093517 May 24 15:38:48.047612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 58/113] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:47 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:48.125045 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9dba5caf-7f49-448c-a555-0f491f8f055a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:48.133487 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9dba5caf-7f49-448c-a555-0f491f8f055a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.174532 May 24 15:38:48.134054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 56/114] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:47 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:48.981260 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f60c9c06-9ebd-4603-9838-f61afcb675f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:48.981260 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f60c9c06-9ebd-4603-9838-f61afcb675f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:48.982105 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d486e66b-e678-49e5-b849-838ba8ef1b7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:48.982105 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d486e66b-e678-49e5-b849-838ba8ef1b7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:48.982541 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d486e66b-e678-49e5-b849-838ba8ef1b7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.982623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d486e66b-e678-49e5-b849-838ba8ef1b7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.982712 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f60c9c06-9ebd-4603-9838-f61afcb675f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.983136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f60c9c06-9ebd-4603-9838-f61afcb675f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.983353 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d486e66b-e678-49e5-b849-838ba8ef1b7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.983771 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d486e66b-e678-49e5-b849-838ba8ef1b7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:48.985684 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f60c9c06-9ebd-4603-9838-f61afcb675f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:48.986158 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f60c9c06-9ebd-4603-9838-f61afcb675f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:49.273462 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d486e66b-e678-49e5-b849-838ba8ef1b7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.280856 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f60c9c06-9ebd-4603-9838-f61afcb675f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.281415 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d486e66b-e678-49e5-b849-838ba8ef1b7b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.317170 May 24 15:38:49.282241 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 59/115] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:48 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:49.292841 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f60c9c06-9ebd-4603-9838-f61afcb675f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.294585 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f60c9c06-9ebd-4603-9838-f61afcb675f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.295738 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f60c9c06-9ebd-4603-9838-f61afcb675f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.329532 May 24 15:38:49.296532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 57/116] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:48 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:49.296993 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-342bb692-1a76-4c2f-bf70-ab18e3d13e4c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:49.297671 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-342bb692-1a76-4c2f-bf70-ab18e3d13e4c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:49.304510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-342bb692-1a76-4c2f-bf70-ab18e3d13e4c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:49.305009 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a13d0fe9-477b-443d-a6b4-6a43ce75bee2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:49.305549 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-342bb692-1a76-4c2f-bf70-ab18e3d13e4c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:49.306555 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a13d0fe9-477b-443d-a6b4-6a43ce75bee2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:49.306890 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-342bb692-1a76-4c2f-bf70-ab18e3d13e4c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:49.307537 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-342bb692-1a76-4c2f-bf70-ab18e3d13e4c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:49.320984 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a13d0fe9-477b-443d-a6b4-6a43ce75bee2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:49.321434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a13d0fe9-477b-443d-a6b4-6a43ce75bee2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:49.322201 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a13d0fe9-477b-443d-a6b4-6a43ce75bee2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:49.322628 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a13d0fe9-477b-443d-a6b4-6a43ce75bee2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:49.598930 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-342bb692-1a76-4c2f-bf70-ab18e3d13e4c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.603043 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a13d0fe9-477b-443d-a6b4-6a43ce75bee2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:49.608162 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-342bb692-1a76-4c2f-bf70-ab18e3d13e4c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.316529 May 24 15:38:49.609258 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 60/117] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:49 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:49.614751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a13d0fe9-477b-443d-a6b4-6a43ce75bee2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.315508 May 24 15:38:49.628891 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 58/118] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:49 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:50.298588 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-347045cb-f270-46dc-b2b9-3f0a37b040f3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:50.299442 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-347045cb-f270-46dc-b2b9-3f0a37b040f3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:50.305962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-347045cb-f270-46dc-b2b9-3f0a37b040f3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.306485 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-347045cb-f270-46dc-b2b9-3f0a37b040f3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.307369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-347045cb-f270-46dc-b2b9-3f0a37b040f3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.307855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-347045cb-f270-46dc-b2b9-3f0a37b040f3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.315314 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c3f59eb8-601e-42c5-89f3-2871055e3cf4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:50.315918 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c3f59eb8-601e-42c5-89f3-2871055e3cf4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:50.326005 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c3f59eb8-601e-42c5-89f3-2871055e3cf4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.326469 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c3f59eb8-601e-42c5-89f3-2871055e3cf4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.327220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c3f59eb8-601e-42c5-89f3-2871055e3cf4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.327663 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c3f59eb8-601e-42c5-89f3-2871055e3cf4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.705532 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-347045cb-f270-46dc-b2b9-3f0a37b040f3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.713710 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-347045cb-f270-46dc-b2b9-3f0a37b040f3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.418847 May 24 15:38:50.714594 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 61/119] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:50 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:50.719651 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ac3abd64-1fd8-4e17-9472-7cbd6e86259d tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:50.720301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ac3abd64-1fd8-4e17-9472-7cbd6e86259d tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:50.728730 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ac3abd64-1fd8-4e17-9472-7cbd6e86259d tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.729415 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ac3abd64-1fd8-4e17-9472-7cbd6e86259d tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.730256 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ac3abd64-1fd8-4e17-9472-7cbd6e86259d tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.730741 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ac3abd64-1fd8-4e17-9472-7cbd6e86259d tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.744868 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c3f59eb8-601e-42c5-89f3-2871055e3cf4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.755157 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c3f59eb8-601e-42c5-89f3-2871055e3cf4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.757733 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c3f59eb8-601e-42c5-89f3-2871055e3cf4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.760148 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c3f59eb8-601e-42c5-89f3-2871055e3cf4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.449508 May 24 15:38:50.761462 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 59/120] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:50 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:38:50.766990 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e6e9d40f-bb9f-4b05-9507-7d68d788388f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:50.768463 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e6e9d40f-bb9f-4b05-9507-7d68d788388f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:50.777484 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e6e9d40f-bb9f-4b05-9507-7d68d788388f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.778032 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e6e9d40f-bb9f-4b05-9507-7d68d788388f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.778928 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e6e9d40f-bb9f-4b05-9507-7d68d788388f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:50.779416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e6e9d40f-bb9f-4b05-9507-7d68d788388f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:50.969561 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ac3abd64-1fd8-4e17-9472-7cbd6e86259d tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.973665 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e6e9d40f-bb9f-4b05-9507-7d68d788388f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:50.979221 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ac3abd64-1fd8-4e17-9472-7cbd6e86259d tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.263194 May 24 15:38:50.980084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 62/121] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:50 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:50.982137 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e6e9d40f-bb9f-4b05-9507-7d68d788388f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.219514 May 24 15:38:50.982701 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 60/122] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:50 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:51.698795 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-82ef3d23-b4c9-4a26-ac26-f451a678990a req-c8489f94-9603-45a8-a8e9-91e5ba0a7697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69fdd945-52b6-4e16-9cd0-06bf19fc5536", "name": "network-vif-plugged", "status": "completed", "tag": "110b6658-6aab-4863-9381-91ebcbd0ce77"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:51.709768 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-82ef3d23-b4c9-4a26-ac26-f451a678990a req-c8489f94-9603-45a8-a8e9-91e5ba0a7697 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.710446 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-82ef3d23-b4c9-4a26-ac26-f451a678990a req-c8489f94-9603-45a8-a8e9-91e5ba0a7697 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.730953 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-627225c4-6b32-4d95-b776-a48ffb3383c9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:51.731553 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-627225c4-6b32-4d95-b776-a48ffb3383c9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:51.732468 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-82ef3d23-b4c9-4a26-ac26-f451a678990a req-c8489f94-9603-45a8-a8e9-91e5ba0a7697 service nova] Creating event network-vif-plugged:110b6658-6aab-4863-9381-91ebcbd0ce77 for instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 on hv-cinder-84315 May 24 15:38:51.738308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-82ef3d23-b4c9-4a26-ac26-f451a678990a req-c8489f94-9603-45a8-a8e9-91e5ba0a7697 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043014 May 24 15:38:51.738874 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-627225c4-6b32-4d95-b776-a48ffb3383c9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.740156 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 63/123] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:51.741349 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-627225c4-6b32-4d95-b776-a48ffb3383c9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.742149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-627225c4-6b32-4d95-b776-a48ffb3383c9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.742590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-627225c4-6b32-4d95-b776-a48ffb3383c9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.780217 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3cb9622b-1c8b-4875-8a1b-3d5279710008 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:51.781121 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3cb9622b-1c8b-4875-8a1b-3d5279710008 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:51.793264 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3cb9622b-1c8b-4875-8a1b-3d5279710008 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.794608 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3cb9622b-1c8b-4875-8a1b-3d5279710008 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:51.796189 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3cb9622b-1c8b-4875-8a1b-3d5279710008 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:51.796856 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3cb9622b-1c8b-4875-8a1b-3d5279710008 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.109894 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-627225c4-6b32-4d95-b776-a48ffb3383c9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.121428 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-627225c4-6b32-4d95-b776-a48ffb3383c9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1315 microversion: 2.1 time: 0.394365 May 24 15:38:52.122021 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 61/124] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:51 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:52.135543 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7fe6d376-8804-4300-92e0-b9a6fc524639 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:52.136484 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7fe6d376-8804-4300-92e0-b9a6fc524639 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:52.150588 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7fe6d376-8804-4300-92e0-b9a6fc524639 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.152816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7fe6d376-8804-4300-92e0-b9a6fc524639 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.156005 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7fe6d376-8804-4300-92e0-b9a6fc524639 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.156758 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7fe6d376-8804-4300-92e0-b9a6fc524639 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.258683 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=4 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:52.320743 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3cb9622b-1c8b-4875-8a1b-3d5279710008 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.331426 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3cb9622b-1c8b-4875-8a1b-3d5279710008 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.333630 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3cb9622b-1c8b-4875-8a1b-3d5279710008 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.338670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3cb9622b-1c8b-4875-8a1b-3d5279710008 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.564108 May 24 15:38:52.339128 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 64/125] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:51 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:52.351267 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4d8e536f-6aac-47fc-a035-3b7c2c4a22a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:52.352149 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-4d8e536f-6aac-47fc-a035-3b7c2c4a22a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:52.361100 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4d8e536f-6aac-47fc-a035-3b7c2c4a22a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.361793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4d8e536f-6aac-47fc-a035-3b7c2c4a22a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.362822 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4d8e536f-6aac-47fc-a035-3b7c2c4a22a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.363733 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4d8e536f-6aac-47fc-a035-3b7c2c4a22a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.448236 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=8 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:52.523064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7fe6d376-8804-4300-92e0-b9a6fc524639 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.532851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7fe6d376-8804-4300-92e0-b9a6fc524639 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.407868 May 24 15:38:52.537562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 62/126] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:52 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:52.716694 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-4d8e536f-6aac-47fc-a035-3b7c2c4a22a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:52.731574 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-4d8e536f-6aac-47fc-a035-3b7c2c4a22a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.389982 May 24 15:38:52.732193 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 65/127] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:52 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:52.927116 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-ea63bbd4-d976-4225-99d1-389bc649079a req-2c2a139a-dabc-4496-8dae-5e995fca2255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47371c4c-744d-41c8-88ce-77c16bb4bbef", "tag": "cf59e677-240a-4b1e-b4d1-2c5ed01afc57"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:52.940077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-ea63bbd4-d976-4225-99d1-389bc649079a req-2c2a139a-dabc-4496-8dae-5e995fca2255 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:52.940514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-ea63bbd4-d976-4225-99d1-389bc649079a req-2c2a139a-dabc-4496-8dae-5e995fca2255 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:52.962326 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-ea63bbd4-d976-4225-99d1-389bc649079a req-2c2a139a-dabc-4496-8dae-5e995fca2255 service nova] Creating event network-changed:cf59e677-240a-4b1e-b4d1-2c5ed01afc57 for instance 47371c4c-744d-41c8-88ce-77c16bb4bbef on hv-cinder-84315 May 24 15:38:52.967215 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-ea63bbd4-d976-4225-99d1-389bc649079a req-2c2a139a-dabc-4496-8dae-5e995fca2255 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044071 May 24 15:38:52.968180 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 63/128] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:53.138569 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b5d76f56-9bdf-40db-bfe5-9a05fdb4cb48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:53.139199 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b5d76f56-9bdf-40db-bfe5-9a05fdb4cb48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:53.150608 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5d76f56-9bdf-40db-bfe5-9a05fdb4cb48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.151058 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5d76f56-9bdf-40db-bfe5-9a05fdb4cb48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.152221 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5d76f56-9bdf-40db-bfe5-9a05fdb4cb48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.152761 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5d76f56-9bdf-40db-bfe5-9a05fdb4cb48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.321401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b5d76f56-9bdf-40db-bfe5-9a05fdb4cb48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.330399 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b5d76f56-9bdf-40db-bfe5-9a05fdb4cb48 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1502 microversion: 2.1 time: 0.195600 May 24 15:38:53.331042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 66/129] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:53 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:53.358791 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c991cd3f-42de-4caf-b646-aea22b56d244 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:53.359485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c991cd3f-42de-4caf-b646-aea22b56d244 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:53.371135 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c991cd3f-42de-4caf-b646-aea22b56d244 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.371657 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c991cd3f-42de-4caf-b646-aea22b56d244 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.372471 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c991cd3f-42de-4caf-b646-aea22b56d244 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.373052 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c991cd3f-42de-4caf-b646-aea22b56d244 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.555616 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-791bf9e4-2e8b-4cac-afb7-7d28ec9e2f21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:53.557212 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-791bf9e4-2e8b-4cac-afb7-7d28ec9e2f21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:53.564684 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c991cd3f-42de-4caf-b646-aea22b56d244 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.566920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-791bf9e4-2e8b-4cac-afb7-7d28ec9e2f21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.567752 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-791bf9e4-2e8b-4cac-afb7-7d28ec9e2f21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.569296 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-791bf9e4-2e8b-4cac-afb7-7d28ec9e2f21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.570763 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-791bf9e4-2e8b-4cac-afb7-7d28ec9e2f21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.573171 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c991cd3f-42de-4caf-b646-aea22b56d244 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.574649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c991cd3f-42de-4caf-b646-aea22b56d244 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.575805 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c991cd3f-42de-4caf-b646-aea22b56d244 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.222274 May 24 15:38:53.578335 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 64/130] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:53 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:53.726805 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-791bf9e4-2e8b-4cac-afb7-7d28ec9e2f21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.748422 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-791bf9e4-2e8b-4cac-afb7-7d28ec9e2f21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.197364 May 24 15:38:53.749089 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 67/131] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:53 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:38:53.755180 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9fb1125c-4f94-42fa-88fd-035b73fcd0b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:53.755784 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9fb1125c-4f94-42fa-88fd-035b73fcd0b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:53.768083 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9fb1125c-4f94-42fa-88fd-035b73fcd0b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.768701 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9fb1125c-4f94-42fa-88fd-035b73fcd0b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.769965 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9fb1125c-4f94-42fa-88fd-035b73fcd0b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.770673 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9fb1125c-4f94-42fa-88fd-035b73fcd0b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.775775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-b7142800-e625-4645-9fb1-d572c5639bbf req-efcc6a34-4a5a-4e81-babf-fba9dfc6c72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d791b8-2dce-43c8-9faa-5af5f5e14d65", "name": "network-vif-plugged", "status": "completed", "tag": "e827b410-d904-420a-8600-036fec1a80f7"}, {"server_uuid": "ca2694ac-4a5e-4cfa-aaf8-877c8285148a", "name": "network-vif-plugged", "status": "completed", "tag": "b4136280-42c5-46f1-8248-0dcb997d0277"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:53.797458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-b7142800-e625-4645-9fb1-d572c5639bbf req-efcc6a34-4a5a-4e81-babf-fba9dfc6c72c service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:53.799009 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-b7142800-e625-4645-9fb1-d572c5639bbf req-efcc6a34-4a5a-4e81-babf-fba9dfc6c72c service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:53.816434 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-b7142800-e625-4645-9fb1-d572c5639bbf req-efcc6a34-4a5a-4e81-babf-fba9dfc6c72c service nova] Creating event network-vif-plugged:e827b410-d904-420a-8600-036fec1a80f7 for instance 84d791b8-2dce-43c8-9faa-5af5f5e14d65 on hv-cinder-84315 May 24 15:38:53.816952 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-b7142800-e625-4645-9fb1-d572c5639bbf req-efcc6a34-4a5a-4e81-babf-fba9dfc6c72c service nova] Creating event network-vif-plugged:b4136280-42c5-46f1-8248-0dcb997d0277 for instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a on hv-cinder-84315 May 24 15:38:53.827201 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-b7142800-e625-4645-9fb1-d572c5639bbf req-efcc6a34-4a5a-4e81-babf-fba9dfc6c72c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063315 May 24 15:38:53.827876 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 68/132] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:38:53.948159 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9fb1125c-4f94-42fa-88fd-035b73fcd0b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:53.955579 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9fb1125c-4f94-42fa-88fd-035b73fcd0b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.204916 May 24 15:38:53.956170 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 65/133] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:53 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:54.595483 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ff9415d6-d986-4939-8118-af17be57e768 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:54.596195 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ff9415d6-d986-4939-8118-af17be57e768 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:54.602814 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ff9415d6-d986-4939-8118-af17be57e768 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.603275 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ff9415d6-d986-4939-8118-af17be57e768 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:54.604015 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ff9415d6-d986-4939-8118-af17be57e768 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.604465 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ff9415d6-d986-4939-8118-af17be57e768 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:54.737942 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ff9415d6-d986-4939-8118-af17be57e768 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:54.746153 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ff9415d6-d986-4939-8118-af17be57e768 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:54.747712 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ff9415d6-d986-4939-8118-af17be57e768 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:54.748934 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ff9415d6-d986-4939-8118-af17be57e768 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.157796 May 24 15:38:54.749584 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 69/134] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:54 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:54.767041 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-abf7c079-4e31-4db2-bc56-8d8ebd324bb2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:54.774056 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-abf7c079-4e31-4db2-bc56-8d8ebd324bb2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:54.781005 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-abf7c079-4e31-4db2-bc56-8d8ebd324bb2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.781447 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-abf7c079-4e31-4db2-bc56-8d8ebd324bb2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:54.782218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-abf7c079-4e31-4db2-bc56-8d8ebd324bb2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.782893 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-abf7c079-4e31-4db2-bc56-8d8ebd324bb2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:54.927555 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-abf7c079-4e31-4db2-bc56-8d8ebd324bb2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:54.935556 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-abf7c079-4e31-4db2-bc56-8d8ebd324bb2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.174841 May 24 15:38:54.936163 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 66/135] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:54 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:54.972489 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1d152648-a34c-4a07-b0c9-f560451ba930 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:54.973102 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1d152648-a34c-4a07-b0c9-f560451ba930 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:54.979185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1d152648-a34c-4a07-b0c9-f560451ba930 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.979623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1d152648-a34c-4a07-b0c9-f560451ba930 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:54.980437 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1d152648-a34c-4a07-b0c9-f560451ba930 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:54.980862 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1d152648-a34c-4a07-b0c9-f560451ba930 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.113041 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1d152648-a34c-4a07-b0c9-f560451ba930 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:55.120514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1d152648-a34c-4a07-b0c9-f560451ba930 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.151901 May 24 15:38:55.121237 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 70/136] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:54 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:55.767645 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-926a0968-c64a-4d97-b2a5-531a9635fd39 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:55.768240 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-926a0968-c64a-4d97-b2a5-531a9635fd39 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:55.775199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-926a0968-c64a-4d97-b2a5-531a9635fd39 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:55.775650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-926a0968-c64a-4d97-b2a5-531a9635fd39 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.776426 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-926a0968-c64a-4d97-b2a5-531a9635fd39 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:55.777200 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-926a0968-c64a-4d97-b2a5-531a9635fd39 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.933397 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-926a0968-c64a-4d97-b2a5-531a9635fd39 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:55.944919 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-926a0968-c64a-4d97-b2a5-531a9635fd39 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:55.947438 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-926a0968-c64a-4d97-b2a5-531a9635fd39 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:55.949311 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-926a0968-c64a-4d97-b2a5-531a9635fd39 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.185315 May 24 15:38:55.950264 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 67/137] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:55 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:55.953416 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1d45cce6-7194-4d56-be22-3a4170603ec7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:55.954022 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1d45cce6-7194-4d56-be22-3a4170603ec7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:55.961135 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1d45cce6-7194-4d56-be22-3a4170603ec7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:55.961578 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1d45cce6-7194-4d56-be22-3a4170603ec7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:55.962527 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1d45cce6-7194-4d56-be22-3a4170603ec7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:55.963636 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1d45cce6-7194-4d56-be22-3a4170603ec7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:56.106649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1d45cce6-7194-4d56-be22-3a4170603ec7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:56.117650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1d45cce6-7194-4d56-be22-3a4170603ec7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.168895 May 24 15:38:56.118209 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 71/138] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:55 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:56.137136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6224cac9-a997-4659-8073-111eca1097f0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:56.137764 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6224cac9-a997-4659-8073-111eca1097f0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:56.144150 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6224cac9-a997-4659-8073-111eca1097f0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:56.144873 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6224cac9-a997-4659-8073-111eca1097f0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:56.145774 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6224cac9-a997-4659-8073-111eca1097f0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:56.146204 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6224cac9-a997-4659-8073-111eca1097f0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:56.339974 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6224cac9-a997-4659-8073-111eca1097f0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:56.356851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6224cac9-a997-4659-8073-111eca1097f0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.223228 May 24 15:38:56.358066 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 68/139] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:56 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:56.968106 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-9d95858a-923b-47a0-8b47-a550efdb1f87 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:56.968777 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-9d95858a-923b-47a0-8b47-a550efdb1f87 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:56.978229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9d95858a-923b-47a0-8b47-a550efdb1f87 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:56.978683 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9d95858a-923b-47a0-8b47-a550efdb1f87 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:56.981182 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9d95858a-923b-47a0-8b47-a550efdb1f87 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:56.981623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9d95858a-923b-47a0-8b47-a550efdb1f87 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.108231 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-8e898b51-2a91-46fa-975e-8233e3403b3d tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44e5561b-d4d3-456c-80ca-26e46b7cd9e7"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:38:57.112199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8e898b51-2a91-46fa-975e-8233e3403b3d tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:57.120581 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8e898b51-2a91-46fa-975e-8233e3403b3d tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.121133 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8e898b51-2a91-46fa-975e-8233e3403b3d tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.122116 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8e898b51-2a91-46fa-975e-8233e3403b3d tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.123106 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8e898b51-2a91-46fa-975e-8233e3403b3d tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.237283 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-9d95858a-923b-47a0-8b47-a550efdb1f87 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.243286 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=100 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:57.253109 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-9d95858a-923b-47a0-8b47-a550efdb1f87 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.255436 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-9d95858a-923b-47a0-8b47-a550efdb1f87 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.256892 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-9d95858a-923b-47a0-8b47-a550efdb1f87 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.293163 May 24 15:38:57.257646 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 72/140] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:56 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:57.262220 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d16545fb-7efc-4b2f-923a-bd4d333e0fa9 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:57.263039 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d16545fb-7efc-4b2f-923a-bd4d333e0fa9 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:57.269500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d16545fb-7efc-4b2f-923a-bd4d333e0fa9 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.270041 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d16545fb-7efc-4b2f-923a-bd4d333e0fa9 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.270818 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d16545fb-7efc-4b2f-923a-bd4d333e0fa9 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.271485 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d16545fb-7efc-4b2f-923a-bd4d333e0fa9 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.418299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d16545fb-7efc-4b2f-923a-bd4d333e0fa9 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.438612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d16545fb-7efc-4b2f-923a-bd4d333e0fa9 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.179649 May 24 15:38:57.439160 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 73/141] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:57 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:57.444995 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-082b6314-3184-4175-8219-bb6ef11b3d43 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:57.445845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-082b6314-3184-4175-8219-bb6ef11b3d43 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:57.452514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082b6314-3184-4175-8219-bb6ef11b3d43 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.452899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082b6314-3184-4175-8219-bb6ef11b3d43 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.453732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082b6314-3184-4175-8219-bb6ef11b3d43 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:57.454109 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082b6314-3184-4175-8219-bb6ef11b3d43 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:57.615377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-082b6314-3184-4175-8219-bb6ef11b3d43 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:57.623926 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-082b6314-3184-4175-8219-bb6ef11b3d43 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.183545 May 24 15:38:57.624519 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 74/142] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:57 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:58.275832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7fcbd4e1-6530-4c30-9ecf-09abd7b0e47b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:58.276790 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7fcbd4e1-6530-4c30-9ecf-09abd7b0e47b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:58.285015 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7fcbd4e1-6530-4c30-9ecf-09abd7b0e47b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.285748 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7fcbd4e1-6530-4c30-9ecf-09abd7b0e47b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.286849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7fcbd4e1-6530-4c30-9ecf-09abd7b0e47b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.287613 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7fcbd4e1-6530-4c30-9ecf-09abd7b0e47b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.530850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7fcbd4e1-6530-4c30-9ecf-09abd7b0e47b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.541374 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7fcbd4e1-6530-4c30-9ecf-09abd7b0e47b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.543746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7fcbd4e1-6530-4c30-9ecf-09abd7b0e47b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.545456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7fcbd4e1-6530-4c30-9ecf-09abd7b0e47b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.273988 May 24 15:38:58.546632 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 75/143] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:58 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:58.552613 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-12e942d3-62ac-4d8d-8fcb-4dd835a8552a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:58.553593 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-12e942d3-62ac-4d8d-8fcb-4dd835a8552a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:58.561623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12e942d3-62ac-4d8d-8fcb-4dd835a8552a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.562793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12e942d3-62ac-4d8d-8fcb-4dd835a8552a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.564369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12e942d3-62ac-4d8d-8fcb-4dd835a8552a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.565152 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12e942d3-62ac-4d8d-8fcb-4dd835a8552a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.719225 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-12e942d3-62ac-4d8d-8fcb-4dd835a8552a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.728742 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-12e942d3-62ac-4d8d-8fcb-4dd835a8552a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.180197 May 24 15:38:58.729314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 76/144] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:58 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:58.734361 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-735f6c20-c453-4f8a-93e2-1a9245931465 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:58.735267 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-735f6c20-c453-4f8a-93e2-1a9245931465 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:58.739299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:38:58.743821 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-735f6c20-c453-4f8a-93e2-1a9245931465 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.744286 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-735f6c20-c453-4f8a-93e2-1a9245931465 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.745041 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-735f6c20-c453-4f8a-93e2-1a9245931465 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:58.745462 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-735f6c20-c453-4f8a-93e2-1a9245931465 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:58.927126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-735f6c20-c453-4f8a-93e2-1a9245931465 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:58.935949 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-735f6c20-c453-4f8a-93e2-1a9245931465 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.205433 May 24 15:38:58.936934 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 77/145] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:58 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:38:59.564416 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b1e78b90-56d6-45d2-a84a-4ca0cfef42b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:59.565086 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b1e78b90-56d6-45d2-a84a-4ca0cfef42b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:59.578096 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b1e78b90-56d6-45d2-a84a-4ca0cfef42b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.579042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b1e78b90-56d6-45d2-a84a-4ca0cfef42b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.581179 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b1e78b90-56d6-45d2-a84a-4ca0cfef42b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.581659 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b1e78b90-56d6-45d2-a84a-4ca0cfef42b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.783170 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b1e78b90-56d6-45d2-a84a-4ca0cfef42b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:59.793372 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b1e78b90-56d6-45d2-a84a-4ca0cfef42b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:59.795415 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b1e78b90-56d6-45d2-a84a-4ca0cfef42b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:38:59.796927 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b1e78b90-56d6-45d2-a84a-4ca0cfef42b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.236867 May 24 15:38:59.797558 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 78/146] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:38:59 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:38:59.803603 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-973c4430-3a69-478b-bb52-6a6e3f28ed1c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:38:59.804300 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-973c4430-3a69-478b-bb52-6a6e3f28ed1c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:38:59.810328 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-973c4430-3a69-478b-bb52-6a6e3f28ed1c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.810986 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-973c4430-3a69-478b-bb52-6a6e3f28ed1c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:38:59.811960 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-973c4430-3a69-478b-bb52-6a6e3f28ed1c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:38:59.812681 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-973c4430-3a69-478b-bb52-6a6e3f28ed1c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.010932 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-973c4430-3a69-478b-bb52-6a6e3f28ed1c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:00.020549 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-973c4430-3a69-478b-bb52-6a6e3f28ed1c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.221693 May 24 15:39:00.023058 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 79/147] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:38:59 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:00.028477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6edd497f-7b49-4b2c-86b9-b98f60d1bc7e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:00.029350 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6edd497f-7b49-4b2c-86b9-b98f60d1bc7e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:00.036255 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6edd497f-7b49-4b2c-86b9-b98f60d1bc7e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.036864 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6edd497f-7b49-4b2c-86b9-b98f60d1bc7e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.038209 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6edd497f-7b49-4b2c-86b9-b98f60d1bc7e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.038784 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6edd497f-7b49-4b2c-86b9-b98f60d1bc7e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.181341 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6edd497f-7b49-4b2c-86b9-b98f60d1bc7e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:00.189700 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6edd497f-7b49-4b2c-86b9-b98f60d1bc7e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.165433 May 24 15:39:00.190272 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 80/148] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:00 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:00.816365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-dce7e69a-3200-4750-8051-1148c34373f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:00.817624 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-dce7e69a-3200-4750-8051-1148c34373f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:00.823650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dce7e69a-3200-4750-8051-1148c34373f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.824135 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dce7e69a-3200-4750-8051-1148c34373f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.824946 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dce7e69a-3200-4750-8051-1148c34373f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:00.825408 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dce7e69a-3200-4750-8051-1148c34373f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:00.980385 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dce7e69a-3200-4750-8051-1148c34373f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:00.989187 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dce7e69a-3200-4750-8051-1148c34373f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:00.990719 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dce7e69a-3200-4750-8051-1148c34373f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:00.991855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-dce7e69a-3200-4750-8051-1148c34373f3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.179515 May 24 15:39:00.992690 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 81/149] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:39:00 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:01.044358 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-599fc85a-7490-4107-a152-911238849e21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:01.045167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-599fc85a-7490-4107-a152-911238849e21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:01.051580 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-599fc85a-7490-4107-a152-911238849e21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:01.052023 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-599fc85a-7490-4107-a152-911238849e21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.052821 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-599fc85a-7490-4107-a152-911238849e21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:01.053252 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-599fc85a-7490-4107-a152-911238849e21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.195217 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-599fc85a-7490-4107-a152-911238849e21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:01.203336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-599fc85a-7490-4107-a152-911238849e21 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.164226 May 24 15:39:01.203898 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 82/150] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:01 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:01.217720 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6393e0f2-c374-4b65-a733-4d9ff31984b3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:01.218328 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6393e0f2-c374-4b65-a733-4d9ff31984b3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:01.224320 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6393e0f2-c374-4b65-a733-4d9ff31984b3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:01.224758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6393e0f2-c374-4b65-a733-4d9ff31984b3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.225510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6393e0f2-c374-4b65-a733-4d9ff31984b3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:01.225935 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6393e0f2-c374-4b65-a733-4d9ff31984b3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:01.360626 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6393e0f2-c374-4b65-a733-4d9ff31984b3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:01.368618 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6393e0f2-c374-4b65-a733-4d9ff31984b3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1321 microversion: 2.1 time: 0.154556 May 24 15:39:01.369248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 83/151] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:01 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:02.009560 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2365c1e2-4c53-4150-b70e-ad046382aaed tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:02.010180 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2365c1e2-4c53-4150-b70e-ad046382aaed tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:02.017132 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2365c1e2-4c53-4150-b70e-ad046382aaed tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.017568 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2365c1e2-4c53-4150-b70e-ad046382aaed tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.018312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2365c1e2-4c53-4150-b70e-ad046382aaed tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.018729 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2365c1e2-4c53-4150-b70e-ad046382aaed tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.155079 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2365c1e2-4c53-4150-b70e-ad046382aaed tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:02.164911 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2365c1e2-4c53-4150-b70e-ad046382aaed tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:02.166395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2365c1e2-4c53-4150-b70e-ad046382aaed tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:02.167500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2365c1e2-4c53-4150-b70e-ad046382aaed tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1406 microversion: 2.20 time: 0.162196 May 24 15:39:02.168070 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 84/152] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:39:02 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:39:02.220935 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-568df98d-99d7-47ae-a397-53316de64375 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:02.221535 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-568df98d-99d7-47ae-a397-53316de64375 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:02.227841 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-568df98d-99d7-47ae-a397-53316de64375 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.228313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-568df98d-99d7-47ae-a397-53316de64375 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.229066 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-568df98d-99d7-47ae-a397-53316de64375 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.229460 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-568df98d-99d7-47ae-a397-53316de64375 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.230378 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=100 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:02.368373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-568df98d-99d7-47ae-a397-53316de64375 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:02.377304 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-568df98d-99d7-47ae-a397-53316de64375 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.160324 May 24 15:39:02.378976 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 85/153] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:02 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:02.390028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-96a69e20-f84e-466a-8eff-b03bb1086737 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:02.390722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-96a69e20-f84e-466a-8eff-b03bb1086737 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:02.392319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-8e898b51-2a91-46fa-975e-8233e3403b3d tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "POST /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.287778 May 24 15:39:02.393047 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 69/154] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:38:57 2022] POST /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9/os-volume_attachments => generated 194 bytes in 5290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:39:02.403407 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96a69e20-f84e-466a-8eff-b03bb1086737 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.404065 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96a69e20-f84e-466a-8eff-b03bb1086737 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.405016 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96a69e20-f84e-466a-8eff-b03bb1086737 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.405548 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96a69e20-f84e-466a-8eff-b03bb1086737 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.547363 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-96a69e20-f84e-466a-8eff-b03bb1086737 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:02.555177 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-96a69e20-f84e-466a-8eff-b03bb1086737 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1514 microversion: 2.1 time: 0.173431 May 24 15:39:02.555740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 86/155] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:02 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:02.573400 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bf14c30f-3e70-41ae-a277-e62f00f5878b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:02.574513 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bf14c30f-3e70-41ae-a277-e62f00f5878b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:02.576459 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=70 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:02.583181 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf14c30f-3e70-41ae-a277-e62f00f5878b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.583633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf14c30f-3e70-41ae-a277-e62f00f5878b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.584480 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf14c30f-3e70-41ae-a277-e62f00f5878b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.585137 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf14c30f-3e70-41ae-a277-e62f00f5878b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.612379 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-bf14c30f-3e70-41ae-a277-e62f00f5878b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'flavor' on Instance uuid 84d791b8-2dce-43c8-9faa-5af5f5e14d65 {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:39:02.872450 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bf14c30f-3e70-41ae-a277-e62f00f5878b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65/action" status: 200 len: 32 microversion: 2.1 time: 0.303935 May 24 15:39:02.873220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 70/156] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:39:02 2022] POST /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65/action => generated 32 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 24 15:39:02.882042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-082bb050-69d4-4451-9bf6-b6527fd50ed5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:02.882649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-082bb050-69d4-4451-9bf6-b6527fd50ed5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:02.889540 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082bb050-69d4-4451-9bf6-b6527fd50ed5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.889540 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082bb050-69d4-4451-9bf6-b6527fd50ed5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:02.890258 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082bb050-69d4-4451-9bf6-b6527fd50ed5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:02.890817 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082bb050-69d4-4451-9bf6-b6527fd50ed5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.060407 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-082bb050-69d4-4451-9bf6-b6527fd50ed5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.068133 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-082bb050-69d4-4451-9bf6-b6527fd50ed5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.189819 May 24 15:39:03.068703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 87/157] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:02 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:03.187100 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0f9fc471-c106-4815-87be-34321e054aba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:03.188227 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0f9fc471-c106-4815-87be-34321e054aba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:03.195481 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0f9fc471-c106-4815-87be-34321e054aba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:03.195980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0f9fc471-c106-4815-87be-34321e054aba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.196838 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0f9fc471-c106-4815-87be-34321e054aba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:03.197408 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0f9fc471-c106-4815-87be-34321e054aba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.341162 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0f9fc471-c106-4815-87be-34321e054aba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.354495 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0f9fc471-c106-4815-87be-34321e054aba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.356460 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0f9fc471-c106-4815-87be-34321e054aba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.357935 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0f9fc471-c106-4815-87be-34321e054aba tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1597 microversion: 2.20 time: 0.176361 May 24 15:39:03.370685 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 71/158] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:39:03 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1597 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:03.376595 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7aa36ed2-af2a-4004-95a2-ce3e1256f372 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:03.377422 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7aa36ed2-af2a-4004-95a2-ce3e1256f372 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:03.397420 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2f1aaf3f-84cf-4125-a682-807e2bc98273 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:03.400326 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2f1aaf3f-84cf-4125-a682-807e2bc98273 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:03.403892 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7aa36ed2-af2a-4004-95a2-ce3e1256f372 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:03.404637 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7aa36ed2-af2a-4004-95a2-ce3e1256f372 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.405781 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7aa36ed2-af2a-4004-95a2-ce3e1256f372 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:03.406419 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7aa36ed2-af2a-4004-95a2-ce3e1256f372 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.427311 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2f1aaf3f-84cf-4125-a682-807e2bc98273 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:03.427798 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2f1aaf3f-84cf-4125-a682-807e2bc98273 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.428638 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2f1aaf3f-84cf-4125-a682-807e2bc98273 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:03.433054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2f1aaf3f-84cf-4125-a682-807e2bc98273 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:03.736927 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7aa36ed2-af2a-4004-95a2-ce3e1256f372 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.361749 May 24 15:39:03.738344 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 88/159] 10.222.0.55 () {60 vars in 1315 bytes} [Tue May 24 15:39:03 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-interface => generated 284 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:39:03.818234 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2f1aaf3f-84cf-4125-a682-807e2bc98273 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:03.826721 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2f1aaf3f-84cf-4125-a682-807e2bc98273 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.435375 May 24 15:39:03.836154 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 72/160] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:03 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:04.092960 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7dcc57c3-aa2c-4e8f-b743-6d57082f4b60 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:04.095621 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7dcc57c3-aa2c-4e8f-b743-6d57082f4b60 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:04.105837 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7dcc57c3-aa2c-4e8f-b743-6d57082f4b60 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.106512 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7dcc57c3-aa2c-4e8f-b743-6d57082f4b60 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.107609 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7dcc57c3-aa2c-4e8f-b743-6d57082f4b60 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.108304 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7dcc57c3-aa2c-4e8f-b743-6d57082f4b60 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.444446 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7dcc57c3-aa2c-4e8f-b743-6d57082f4b60 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:04.447045 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=100 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:04.453861 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7dcc57c3-aa2c-4e8f-b743-6d57082f4b60 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.370979 May 24 15:39:04.454689 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 89/161] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:04 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:04.852937 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7087c47d-80d6-446c-90a8-701ad5f593de tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:04.853548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7087c47d-80d6-446c-90a8-701ad5f593de tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:04.861124 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7087c47d-80d6-446c-90a8-701ad5f593de tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.861770 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7087c47d-80d6-446c-90a8-701ad5f593de tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.862747 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7087c47d-80d6-446c-90a8-701ad5f593de tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:04.866355 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7087c47d-80d6-446c-90a8-701ad5f593de tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:04.993267 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7087c47d-80d6-446c-90a8-701ad5f593de tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:05.000881 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7087c47d-80d6-446c-90a8-701ad5f593de tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.151806 May 24 15:39:05.001441 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 73/162] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:04 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:05.189379 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-20f28fa3-b78e-4f02-8399-2304f9e1840b req-d37c428c-7725-438a-a9f9-15f37699de83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2694ac-4a5e-4cfa-aaf8-877c8285148a", "tag": "b4136280-42c5-46f1-8248-0dcb997d0277"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:05.197510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-20f28fa3-b78e-4f02-8399-2304f9e1840b req-d37c428c-7725-438a-a9f9-15f37699de83 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:05.197939 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-20f28fa3-b78e-4f02-8399-2304f9e1840b req-d37c428c-7725-438a-a9f9-15f37699de83 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:05.209065 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-20f28fa3-b78e-4f02-8399-2304f9e1840b req-d37c428c-7725-438a-a9f9-15f37699de83 service nova] Creating event network-changed:b4136280-42c5-46f1-8248-0dcb997d0277 for instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a on hv-cinder-84315 May 24 15:39:05.214231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-20f28fa3-b78e-4f02-8399-2304f9e1840b req-d37c428c-7725-438a-a9f9-15f37699de83 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028624 May 24 15:39:05.214991 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 90/163] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:39:05.471517 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-cb0753a1-e319-465a-ab17-f36f760b9c8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:05.472442 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-cb0753a1-e319-465a-ab17-f36f760b9c8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:05.479288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cb0753a1-e319-465a-ab17-f36f760b9c8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:05.479785 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cb0753a1-e319-465a-ab17-f36f760b9c8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:05.480481 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cb0753a1-e319-465a-ab17-f36f760b9c8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:05.481110 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cb0753a1-e319-465a-ab17-f36f760b9c8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:05.617645 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-cb0753a1-e319-465a-ab17-f36f760b9c8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:05.625509 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-cb0753a1-e319-465a-ab17-f36f760b9c8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.157857 May 24 15:39:05.626087 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 74/164] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:05 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:06.018816 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-bdf00cc6-b190-4083-9039-d3ffe5d89c07 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:06.019654 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-bdf00cc6-b190-4083-9039-d3ffe5d89c07 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:06.026023 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bdf00cc6-b190-4083-9039-d3ffe5d89c07 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.026915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bdf00cc6-b190-4083-9039-d3ffe5d89c07 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.027501 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bdf00cc6-b190-4083-9039-d3ffe5d89c07 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.027934 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bdf00cc6-b190-4083-9039-d3ffe5d89c07 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.161685 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-bdf00cc6-b190-4083-9039-d3ffe5d89c07 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:06.169274 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-bdf00cc6-b190-4083-9039-d3ffe5d89c07 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.154729 May 24 15:39:06.169868 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 91/165] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:06 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:06.645627 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-eafae93b-6d28-460a-b7c3-bbfa1453de24 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:06.646374 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-eafae93b-6d28-460a-b7c3-bbfa1453de24 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:06.655121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eafae93b-6d28-460a-b7c3-bbfa1453de24 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.655678 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eafae93b-6d28-460a-b7c3-bbfa1453de24 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.656657 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eafae93b-6d28-460a-b7c3-bbfa1453de24 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:06.657197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eafae93b-6d28-460a-b7c3-bbfa1453de24 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:06.801481 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-eafae93b-6d28-460a-b7c3-bbfa1453de24 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:06.809455 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-eafae93b-6d28-460a-b7c3-bbfa1453de24 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.169675 May 24 15:39:06.809996 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 75/166] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:06 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:07.188074 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-913f3314-6619-40d4-a8c4-cd741fbc7961 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:07.188717 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-913f3314-6619-40d4-a8c4-cd741fbc7961 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:07.196054 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-913f3314-6619-40d4-a8c4-cd741fbc7961 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.196500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-913f3314-6619-40d4-a8c4-cd741fbc7961 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.197253 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-913f3314-6619-40d4-a8c4-cd741fbc7961 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.197716 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-913f3314-6619-40d4-a8c4-cd741fbc7961 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.332147 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-913f3314-6619-40d4-a8c4-cd741fbc7961 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:07.339616 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-913f3314-6619-40d4-a8c4-cd741fbc7961 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.157160 May 24 15:39:07.340188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 92/167] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:07 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:07.830837 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b930a86c-c0bc-40d6-9d0b-68af82011876 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:07.831875 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b930a86c-c0bc-40d6-9d0b-68af82011876 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:07.843113 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b930a86c-c0bc-40d6-9d0b-68af82011876 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.843752 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b930a86c-c0bc-40d6-9d0b-68af82011876 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.845052 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b930a86c-c0bc-40d6-9d0b-68af82011876 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:07.845766 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b930a86c-c0bc-40d6-9d0b-68af82011876 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:07.991649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b930a86c-c0bc-40d6-9d0b-68af82011876 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:08.000481 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b930a86c-c0bc-40d6-9d0b-68af82011876 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.176110 May 24 15:39:08.001266 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 76/168] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:07 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:08.356623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-51491580-9d4e-4335-bc35-ff903d7ce478 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:08.357308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-51491580-9d4e-4335-bc35-ff903d7ce478 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:08.363338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-51491580-9d4e-4335-bc35-ff903d7ce478 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:08.363831 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-51491580-9d4e-4335-bc35-ff903d7ce478 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:08.364610 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-51491580-9d4e-4335-bc35-ff903d7ce478 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:08.365031 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-51491580-9d4e-4335-bc35-ff903d7ce478 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:08.499143 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-51491580-9d4e-4335-bc35-ff903d7ce478 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:08.506994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-51491580-9d4e-4335-bc35-ff903d7ce478 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.154168 May 24 15:39:08.507558 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 93/169] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:08 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:09.021817 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-22f5afd8-7de1-4b3a-bb58-003cf2507cff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:09.022614 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-22f5afd8-7de1-4b3a-bb58-003cf2507cff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:09.031220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-22f5afd8-7de1-4b3a-bb58-003cf2507cff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.031781 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-22f5afd8-7de1-4b3a-bb58-003cf2507cff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.032771 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-22f5afd8-7de1-4b3a-bb58-003cf2507cff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.033309 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-22f5afd8-7de1-4b3a-bb58-003cf2507cff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.169918 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-22f5afd8-7de1-4b3a-bb58-003cf2507cff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:09.181676 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-22f5afd8-7de1-4b3a-bb58-003cf2507cff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.165817 May 24 15:39:09.182324 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 77/170] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:09 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:09.524344 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3f539630-45b2-45de-862d-c2e4eda1b169 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:09.524910 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3f539630-45b2-45de-862d-c2e4eda1b169 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:09.531555 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3f539630-45b2-45de-862d-c2e4eda1b169 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.531994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3f539630-45b2-45de-862d-c2e4eda1b169 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.532842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3f539630-45b2-45de-862d-c2e4eda1b169 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:09.533264 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3f539630-45b2-45de-862d-c2e4eda1b169 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:09.682239 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3f539630-45b2-45de-862d-c2e4eda1b169 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:09.690814 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3f539630-45b2-45de-862d-c2e4eda1b169 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.169787 May 24 15:39:09.690814 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 94/171] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:09 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:10.202749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1f1ecc13-7987-4e02-8e0a-a8e6df93d037 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:10.203742 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1f1ecc13-7987-4e02-8e0a-a8e6df93d037 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:10.212076 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1f1ecc13-7987-4e02-8e0a-a8e6df93d037 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:10.212543 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1f1ecc13-7987-4e02-8e0a-a8e6df93d037 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:10.213304 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1f1ecc13-7987-4e02-8e0a-a8e6df93d037 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:10.213730 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1f1ecc13-7987-4e02-8e0a-a8e6df93d037 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:10.348422 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1f1ecc13-7987-4e02-8e0a-a8e6df93d037 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:10.355989 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1f1ecc13-7987-4e02-8e0a-a8e6df93d037 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.159723 May 24 15:39:10.356578 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 78/172] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:10 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:10.706972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-71e32dba-0075-4a3b-9bf6-836fdf03a4f6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:10.707564 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-71e32dba-0075-4a3b-9bf6-836fdf03a4f6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:10.714498 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-71e32dba-0075-4a3b-9bf6-836fdf03a4f6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:10.715362 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-71e32dba-0075-4a3b-9bf6-836fdf03a4f6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:10.716888 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-71e32dba-0075-4a3b-9bf6-836fdf03a4f6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:10.716888 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-71e32dba-0075-4a3b-9bf6-836fdf03a4f6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:10.905002 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-71e32dba-0075-4a3b-9bf6-836fdf03a4f6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:10.915357 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-71e32dba-0075-4a3b-9bf6-836fdf03a4f6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.212274 May 24 15:39:10.916180 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 95/173] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:10 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:11.374572 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7c72ae1d-643d-4617-a0b9-488c9cb06d7a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:11.375792 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7c72ae1d-643d-4617-a0b9-488c9cb06d7a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:11.383227 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7c72ae1d-643d-4617-a0b9-488c9cb06d7a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.384106 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7c72ae1d-643d-4617-a0b9-488c9cb06d7a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.385173 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7c72ae1d-643d-4617-a0b9-488c9cb06d7a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.385746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7c72ae1d-643d-4617-a0b9-488c9cb06d7a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.699129 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7c72ae1d-643d-4617-a0b9-488c9cb06d7a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:11.708661 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7c72ae1d-643d-4617-a0b9-488c9cb06d7a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.338929 May 24 15:39:11.719649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 79/174] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:11 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:11.932983 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e35f3482-2462-4214-b381-a5c4b904d8d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:11.933614 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e35f3482-2462-4214-b381-a5c4b904d8d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:11.946463 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e35f3482-2462-4214-b381-a5c4b904d8d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.947001 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e35f3482-2462-4214-b381-a5c4b904d8d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:11.949948 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e35f3482-2462-4214-b381-a5c4b904d8d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:11.950405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e35f3482-2462-4214-b381-a5c4b904d8d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.115887 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e35f3482-2462-4214-b381-a5c4b904d8d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:12.124239 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e35f3482-2462-4214-b381-a5c4b904d8d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.195272 May 24 15:39:12.124712 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 96/175] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:11 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:12.726170 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7f33d475-49b4-4b31-a303-c66472e8b18f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:12.726669 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7f33d475-49b4-4b31-a303-c66472e8b18f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:12.732772 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f33d475-49b4-4b31-a303-c66472e8b18f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:12.733206 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f33d475-49b4-4b31-a303-c66472e8b18f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.733958 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f33d475-49b4-4b31-a303-c66472e8b18f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:12.734390 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f33d475-49b4-4b31-a303-c66472e8b18f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:12.883674 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7f33d475-49b4-4b31-a303-c66472e8b18f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:12.891088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7f33d475-49b4-4b31-a303-c66472e8b18f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.169420 May 24 15:39:12.901547 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 80/176] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:12 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:13.141069 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6d7d0df4-be4e-47d4-baac-3483c6988597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:13.141927 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6d7d0df4-be4e-47d4-baac-3483c6988597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:13.148368 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6d7d0df4-be4e-47d4-baac-3483c6988597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.148808 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6d7d0df4-be4e-47d4-baac-3483c6988597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.149569 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6d7d0df4-be4e-47d4-baac-3483c6988597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.149989 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6d7d0df4-be4e-47d4-baac-3483c6988597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.325206 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6d7d0df4-be4e-47d4-baac-3483c6988597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:13.332925 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6d7d0df4-be4e-47d4-baac-3483c6988597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.195595 May 24 15:39:13.333748 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 97/177] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:13 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:13.908385 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-641493d5-fa4a-40ee-99a4-2fb27e5c05e3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:13.912855 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-641493d5-fa4a-40ee-99a4-2fb27e5c05e3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:13.920415 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-641493d5-fa4a-40ee-99a4-2fb27e5c05e3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.921586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-641493d5-fa4a-40ee-99a4-2fb27e5c05e3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:13.922375 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-641493d5-fa4a-40ee-99a4-2fb27e5c05e3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:13.922814 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-641493d5-fa4a-40ee-99a4-2fb27e5c05e3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.057610 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-641493d5-fa4a-40ee-99a4-2fb27e5c05e3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:14.065376 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-641493d5-fa4a-40ee-99a4-2fb27e5c05e3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.160973 May 24 15:39:14.066015 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 81/178] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:13 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:14.353113 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1e120a9f-e83c-44b4-a798-07ebb0230346 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:14.354442 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1e120a9f-e83c-44b4-a798-07ebb0230346 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:14.361789 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1e120a9f-e83c-44b4-a798-07ebb0230346 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:14.362313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1e120a9f-e83c-44b4-a798-07ebb0230346 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.363209 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1e120a9f-e83c-44b4-a798-07ebb0230346 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:14.363771 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1e120a9f-e83c-44b4-a798-07ebb0230346 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:14.575474 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1e120a9f-e83c-44b4-a798-07ebb0230346 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:14.584080 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1e120a9f-e83c-44b4-a798-07ebb0230346 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.238889 May 24 15:39:14.584628 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 98/179] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:14 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:15.082522 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e6b1f233-bf36-4ff9-8cc0-5ede9a994065 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:15.083134 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e6b1f233-bf36-4ff9-8cc0-5ede9a994065 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:15.089578 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e6b1f233-bf36-4ff9-8cc0-5ede9a994065 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:15.090024 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e6b1f233-bf36-4ff9-8cc0-5ede9a994065 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:15.090818 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e6b1f233-bf36-4ff9-8cc0-5ede9a994065 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:15.091225 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e6b1f233-bf36-4ff9-8cc0-5ede9a994065 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:15.225584 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e6b1f233-bf36-4ff9-8cc0-5ede9a994065 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:15.233733 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e6b1f233-bf36-4ff9-8cc0-5ede9a994065 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.155095 May 24 15:39:15.234434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 82/180] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:15 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:15.601238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6f2c52a9-b97f-4317-9c1e-35e26428e40a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:15.601937 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6f2c52a9-b97f-4317-9c1e-35e26428e40a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:15.608406 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6f2c52a9-b97f-4317-9c1e-35e26428e40a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:15.608854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6f2c52a9-b97f-4317-9c1e-35e26428e40a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:15.609620 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6f2c52a9-b97f-4317-9c1e-35e26428e40a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:15.610056 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6f2c52a9-b97f-4317-9c1e-35e26428e40a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:15.758555 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6f2c52a9-b97f-4317-9c1e-35e26428e40a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:15.766026 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6f2c52a9-b97f-4317-9c1e-35e26428e40a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.169092 May 24 15:39:15.776876 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 99/181] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:15 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:16.250771 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-785fb430-656f-4f5f-9b77-65be66e6015a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:16.251342 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-785fb430-656f-4f5f-9b77-65be66e6015a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:16.258012 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-785fb430-656f-4f5f-9b77-65be66e6015a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:16.258737 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-785fb430-656f-4f5f-9b77-65be66e6015a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:16.259600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-785fb430-656f-4f5f-9b77-65be66e6015a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:16.260237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-785fb430-656f-4f5f-9b77-65be66e6015a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:16.279895 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:16.412561 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-785fb430-656f-4f5f-9b77-65be66e6015a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:16.420577 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-785fb430-656f-4f5f-9b77-65be66e6015a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.173490 May 24 15:39:16.421229 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 83/182] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:16 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:16.785335 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e251caeb-aceb-4f20-9a8a-f48fdca3b19b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:16.786215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e251caeb-aceb-4f20-9a8a-f48fdca3b19b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:16.794885 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e251caeb-aceb-4f20-9a8a-f48fdca3b19b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:16.796060 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e251caeb-aceb-4f20-9a8a-f48fdca3b19b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:16.797054 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e251caeb-aceb-4f20-9a8a-f48fdca3b19b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:16.797468 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e251caeb-aceb-4f20-9a8a-f48fdca3b19b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:16.951422 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e251caeb-aceb-4f20-9a8a-f48fdca3b19b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:16.959079 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e251caeb-aceb-4f20-9a8a-f48fdca3b19b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.178432 May 24 15:39:16.959657 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 100/183] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:16 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:17.438649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4d24644f-d991-4e4f-a577-9e3ad3af1bec tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:17.439265 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4d24644f-d991-4e4f-a577-9e3ad3af1bec tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:17.445635 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-57765993-240e-4455-9327-0510f5862d35 req-bcf0fc0d-da60-49f4-8372-4da1b1273f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47371c4c-744d-41c8-88ce-77c16bb4bbef", "name": "network-vif-plugged", "status": "completed", "tag": "cf59e677-240a-4b1e-b4d1-2c5ed01afc57"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:17.450134 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d24644f-d991-4e4f-a577-9e3ad3af1bec tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:17.451639 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d24644f-d991-4e4f-a577-9e3ad3af1bec tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:17.453089 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d24644f-d991-4e4f-a577-9e3ad3af1bec tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:17.454975 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d24644f-d991-4e4f-a577-9e3ad3af1bec tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:17.455830 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-57765993-240e-4455-9327-0510f5862d35 req-bcf0fc0d-da60-49f4-8372-4da1b1273f40 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:17.456486 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-57765993-240e-4455-9327-0510f5862d35 req-bcf0fc0d-da60-49f4-8372-4da1b1273f40 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:17.473331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-57765993-240e-4455-9327-0510f5862d35 req-bcf0fc0d-da60-49f4-8372-4da1b1273f40 service nova] Creating event network-vif-plugged:cf59e677-240a-4b1e-b4d1-2c5ed01afc57 for instance 47371c4c-744d-41c8-88ce-77c16bb4bbef on hv-cinder-84315 May 24 15:39:17.485971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-57765993-240e-4455-9327-0510f5862d35 req-bcf0fc0d-da60-49f4-8372-4da1b1273f40 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043952 May 24 15:39:17.487829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 101/184] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:39:17.634644 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4d24644f-d991-4e4f-a577-9e3ad3af1bec tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:17.646305 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4d24644f-d991-4e4f-a577-9e3ad3af1bec tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.211823 May 24 15:39:17.646942 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 84/185] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:17 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:17.977288 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1f290b2b-e725-4a86-9b7f-d532c982817c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:17.978920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1f290b2b-e725-4a86-9b7f-d532c982817c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:17.986517 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1f290b2b-e725-4a86-9b7f-d532c982817c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:17.988206 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1f290b2b-e725-4a86-9b7f-d532c982817c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:17.989999 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1f290b2b-e725-4a86-9b7f-d532c982817c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:17.990941 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1f290b2b-e725-4a86-9b7f-d532c982817c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.185913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1f290b2b-e725-4a86-9b7f-d532c982817c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:18.193673 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1f290b2b-e725-4a86-9b7f-d532c982817c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.221166 May 24 15:39:18.194439 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 102/186] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:17 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:18.662785 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-cbdde629-f6c1-462b-9a34-034e4d297546 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:18.669446 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-cbdde629-f6c1-462b-9a34-034e4d297546 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:18.677428 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cbdde629-f6c1-462b-9a34-034e4d297546 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:18.678112 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cbdde629-f6c1-462b-9a34-034e4d297546 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.679069 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cbdde629-f6c1-462b-9a34-034e4d297546 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:18.679653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cbdde629-f6c1-462b-9a34-034e4d297546 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:18.879389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-cbdde629-f6c1-462b-9a34-034e4d297546 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:18.888041 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-cbdde629-f6c1-462b-9a34-034e4d297546 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.229171 May 24 15:39:18.889203 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 85/187] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:18 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:19.212606 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a622ac65-1d80-4f60-9def-672e610d5ef8 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:19.213373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a622ac65-1d80-4f60-9def-672e610d5ef8 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:19.222879 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a622ac65-1d80-4f60-9def-672e610d5ef8 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.223330 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a622ac65-1d80-4f60-9def-672e610d5ef8 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.224194 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a622ac65-1d80-4f60-9def-672e610d5ef8 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.224631 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a622ac65-1d80-4f60-9def-672e610d5ef8 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.425371 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a622ac65-1d80-4f60-9def-672e610d5ef8 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:19.435624 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a622ac65-1d80-4f60-9def-672e610d5ef8 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.228164 May 24 15:39:19.436976 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 103/188] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:19 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:19.837851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7f993001-ff6b-426a-b903-31d7a00e4845 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:19.838462 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7f993001-ff6b-426a-b903-31d7a00e4845 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:19.845286 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f993001-ff6b-426a-b903-31d7a00e4845 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.845789 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f993001-ff6b-426a-b903-31d7a00e4845 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.846556 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f993001-ff6b-426a-b903-31d7a00e4845 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.846981 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f993001-ff6b-426a-b903-31d7a00e4845 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.874345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7f993001-ff6b-426a-b903-31d7a00e4845 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:39:19.906195 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7a25c606-76b3-4825-bcd0-2b6902c9dc0d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:19.906883 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7a25c606-76b3-4825-bcd0-2b6902c9dc0d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:19.913775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7a25c606-76b3-4825-bcd0-2b6902c9dc0d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.914544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7a25c606-76b3-4825-bcd0-2b6902c9dc0d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.915536 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7a25c606-76b3-4825-bcd0-2b6902c9dc0d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:19.916043 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7a25c606-76b3-4825-bcd0-2b6902c9dc0d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:19.988300 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7f993001-ff6b-426a-b903-31d7a00e4845 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "DELETE /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 204 len: 0 microversion: 2.1 time: 0.153933 May 24 15:39:19.992552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 86/189] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:39:19 2022] DELETE /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:39:20.001384 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4969ca76-baf9-460a-8345-689598bd62e5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:20.002435 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4969ca76-baf9-460a-8345-689598bd62e5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:20.012285 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4969ca76-baf9-460a-8345-689598bd62e5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.013321 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4969ca76-baf9-460a-8345-689598bd62e5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.014615 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4969ca76-baf9-460a-8345-689598bd62e5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.015524 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4969ca76-baf9-460a-8345-689598bd62e5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.219055 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7a25c606-76b3-4825-bcd0-2b6902c9dc0d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:20.229859 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7a25c606-76b3-4825-bcd0-2b6902c9dc0d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.328197 May 24 15:39:20.239948 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 104/190] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:19 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:20.312958 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4969ca76-baf9-460a-8345-689598bd62e5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:20.327021 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4969ca76-baf9-460a-8345-689598bd62e5 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1554 microversion: 2.1 time: 0.331904 May 24 15:39:20.327653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 87/191] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:19 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1554 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:20.453600 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e3b093bd-097d-4628-923b-418db357f4e6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:20.454373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e3b093bd-097d-4628-923b-418db357f4e6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:20.461002 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e3b093bd-097d-4628-923b-418db357f4e6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.461444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e3b093bd-097d-4628-923b-418db357f4e6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.462201 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e3b093bd-097d-4628-923b-418db357f4e6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:20.462699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e3b093bd-097d-4628-923b-418db357f4e6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:20.607661 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e3b093bd-097d-4628-923b-418db357f4e6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:20.617346 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e3b093bd-097d-4628-923b-418db357f4e6 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.167455 May 24 15:39:20.618091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 105/192] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:20 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:21.247319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2dd4d782-09c1-460f-9cd2-bbc8c88e811a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:21.248236 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2dd4d782-09c1-460f-9cd2-bbc8c88e811a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:21.255630 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2dd4d782-09c1-460f-9cd2-bbc8c88e811a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.256269 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2dd4d782-09c1-460f-9cd2-bbc8c88e811a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.257424 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2dd4d782-09c1-460f-9cd2-bbc8c88e811a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.257956 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2dd4d782-09c1-460f-9cd2-bbc8c88e811a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.344509 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a9dafe5b-7b16-4ff1-80b4-de7b89e0e761 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:21.345825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a9dafe5b-7b16-4ff1-80b4-de7b89e0e761 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:21.352293 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a9dafe5b-7b16-4ff1-80b4-de7b89e0e761 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.352981 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a9dafe5b-7b16-4ff1-80b4-de7b89e0e761 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.353986 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a9dafe5b-7b16-4ff1-80b4-de7b89e0e761 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.354718 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a9dafe5b-7b16-4ff1-80b4-de7b89e0e761 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.482716 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2dd4d782-09c1-460f-9cd2-bbc8c88e811a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:21.492539 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2dd4d782-09c1-460f-9cd2-bbc8c88e811a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.249704 May 24 15:39:21.493811 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 88/193] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:21 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:21.536279 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a9dafe5b-7b16-4ff1-80b4-de7b89e0e761 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:21.550469 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a9dafe5b-7b16-4ff1-80b4-de7b89e0e761 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1554 microversion: 2.1 time: 0.209198 May 24 15:39:21.560778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 106/194] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:21 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:21.635647 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-53cdbfad-a2b9-44c3-bcb8-6e92aa39b551 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:21.639812 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-53cdbfad-a2b9-44c3-bcb8-6e92aa39b551 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:21.646675 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-53cdbfad-a2b9-44c3-bcb8-6e92aa39b551 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.647116 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-53cdbfad-a2b9-44c3-bcb8-6e92aa39b551 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.647877 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-53cdbfad-a2b9-44c3-bcb8-6e92aa39b551 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:21.648354 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-53cdbfad-a2b9-44c3-bcb8-6e92aa39b551 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:21.826580 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-53cdbfad-a2b9-44c3-bcb8-6e92aa39b551 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:21.835259 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-53cdbfad-a2b9-44c3-bcb8-6e92aa39b551 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1314 microversion: 2.1 time: 0.203686 May 24 15:39:21.845010 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 89/195] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:21 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:22.512838 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b3f789b9-70bd-494e-9ca0-ba3c40a0447e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:22.513963 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b3f789b9-70bd-494e-9ca0-ba3c40a0447e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:22.520719 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b3f789b9-70bd-494e-9ca0-ba3c40a0447e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.524749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b3f789b9-70bd-494e-9ca0-ba3c40a0447e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.526223 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b3f789b9-70bd-494e-9ca0-ba3c40a0447e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.527590 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b3f789b9-70bd-494e-9ca0-ba3c40a0447e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.568175 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-27c98c5d-49de-4fe5-b3ec-ab07247becc3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:22.568781 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-27c98c5d-49de-4fe5-b3ec-ab07247becc3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:22.576299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27c98c5d-49de-4fe5-b3ec-ab07247becc3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.576743 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27c98c5d-49de-4fe5-b3ec-ab07247becc3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.577503 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27c98c5d-49de-4fe5-b3ec-ab07247becc3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.577927 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27c98c5d-49de-4fe5-b3ec-ab07247becc3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.774965 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b3f789b9-70bd-494e-9ca0-ba3c40a0447e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:22.784344 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=100 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:22.788728 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b3f789b9-70bd-494e-9ca0-ba3c40a0447e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.281215 May 24 15:39:22.789631 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 107/196] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:22 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:22.803477 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-27c98c5d-49de-4fe5-b3ec-ab07247becc3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:22.812186 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-27c98c5d-49de-4fe5-b3ec-ab07247becc3 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1554 microversion: 2.1 time: 0.248066 May 24 15:39:22.812751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 90/197] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:22 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1554 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:22.853525 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7ec302e9-32a9-4358-9501-750a0767e0f7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:22.854173 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7ec302e9-32a9-4358-9501-750a0767e0f7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:22.861188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7ec302e9-32a9-4358-9501-750a0767e0f7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.861987 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7ec302e9-32a9-4358-9501-750a0767e0f7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:22.870878 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7ec302e9-32a9-4358-9501-750a0767e0f7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:22.871588 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7ec302e9-32a9-4358-9501-750a0767e0f7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:23.021811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7ec302e9-32a9-4358-9501-750a0767e0f7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:23.031649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7ec302e9-32a9-4358-9501-750a0767e0f7 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1497 microversion: 2.1 time: 0.182716 May 24 15:39:23.032413 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 108/198] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:22 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:23.808597 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-cf8c6c65-4766-4fbc-85b6-de7cc79a1843 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:23.810036 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-cf8c6c65-4766-4fbc-85b6-de7cc79a1843 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:23.820127 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cf8c6c65-4766-4fbc-85b6-de7cc79a1843 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:23.821600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cf8c6c65-4766-4fbc-85b6-de7cc79a1843 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:23.822485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cf8c6c65-4766-4fbc-85b6-de7cc79a1843 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:23.823628 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cf8c6c65-4766-4fbc-85b6-de7cc79a1843 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:23.833747 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d04c58b9-e045-42e5-911f-680d4ad6d2b0 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:23.835180 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d04c58b9-e045-42e5-911f-680d4ad6d2b0 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:23.844737 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d04c58b9-e045-42e5-911f-680d4ad6d2b0 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:23.845772 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d04c58b9-e045-42e5-911f-680d4ad6d2b0 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:23.846730 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d04c58b9-e045-42e5-911f-680d4ad6d2b0 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:23.847284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d04c58b9-e045-42e5-911f-680d4ad6d2b0 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.154105 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-cf8c6c65-4766-4fbc-85b6-de7cc79a1843 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:24.164785 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d04c58b9-e045-42e5-911f-680d4ad6d2b0 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:24.186333 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-cf8c6c65-4766-4fbc-85b6-de7cc79a1843 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.382860 May 24 15:39:24.187583 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d04c58b9-e045-42e5-911f-680d4ad6d2b0 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1554 microversion: 2.1 time: 0.360392 May 24 15:39:24.189339 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 91/199] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:23 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:24.189763 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 109/200] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:23 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1554 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:24.195210 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-68a07afb-0194-4bc1-a268-6d8383f8ca9b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:24.195797 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-68a07afb-0194-4bc1-a268-6d8383f8ca9b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:24.203318 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-68a07afb-0194-4bc1-a268-6d8383f8ca9b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:24.204197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-68a07afb-0194-4bc1-a268-6d8383f8ca9b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.205211 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-68a07afb-0194-4bc1-a268-6d8383f8ca9b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:24.206298 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-68a07afb-0194-4bc1-a268-6d8383f8ca9b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.310342 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-68a07afb-0194-4bc1-a268-6d8383f8ca9b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:39:24.450900 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-68a07afb-0194-4bc1-a268-6d8383f8ca9b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "DELETE /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 204 len: 0 microversion: 2.1 time: 0.259307 May 24 15:39:24.452246 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 92/201] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:39:24 2022] DELETE /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:39:24.461023 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-03628d9d-424b-432a-8c6f-ab7febd7e265 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:24.474702 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-03628d9d-424b-432a-8c6f-ab7febd7e265 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:24.486942 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-03628d9d-424b-432a-8c6f-ab7febd7e265 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:24.490407 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-03628d9d-424b-432a-8c6f-ab7febd7e265 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.491426 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-03628d9d-424b-432a-8c6f-ab7febd7e265 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:24.497472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-03628d9d-424b-432a-8c6f-ab7febd7e265 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.569635 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-4d2073be-6d64-42fb-bdbb-249683fdeb7c req-adb9e98e-0254-4f95-a659-e7a08ff176e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baac3150-841e-41d4-8408-93df2ec929c9", "name": "network-vif-deleted", "tag": "96344a89-ed01-4bee-abb4-d0e1e6ef0c96"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:24.595301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-4d2073be-6d64-42fb-bdbb-249683fdeb7c req-adb9e98e-0254-4f95-a659-e7a08ff176e5 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:24.596172 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-4d2073be-6d64-42fb-bdbb-249683fdeb7c req-adb9e98e-0254-4f95-a659-e7a08ff176e5 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:24.608609 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-4d2073be-6d64-42fb-bdbb-249683fdeb7c req-adb9e98e-0254-4f95-a659-e7a08ff176e5 service nova] Creating event network-vif-deleted:96344a89-ed01-4bee-abb4-d0e1e6ef0c96 for instance baac3150-841e-41d4-8408-93df2ec929c9 on hv-cinder-84315 May 24 15:39:24.615490 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-4d2073be-6d64-42fb-bdbb-249683fdeb7c req-adb9e98e-0254-4f95-a659-e7a08ff176e5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052546 May 24 15:39:24.616733 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 93/202] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:39:24.777314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-03628d9d-424b-432a-8c6f-ab7febd7e265 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:24.785683 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-03628d9d-424b-432a-8c6f-ab7febd7e265 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1503 microversion: 2.1 time: 0.328747 May 24 15:39:24.786708 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 110/203] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:24 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1503 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:25.208813 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f0506d22-63bf-408c-87ca-93d26b05d254 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:25.209510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f0506d22-63bf-408c-87ca-93d26b05d254 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:25.217933 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f0506d22-63bf-408c-87ca-93d26b05d254 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.217933 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f0506d22-63bf-408c-87ca-93d26b05d254 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.218588 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f0506d22-63bf-408c-87ca-93d26b05d254 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.219203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f0506d22-63bf-408c-87ca-93d26b05d254 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.221194 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1ac6796a-fc92-4f8e-aaf3-4f1c417292d4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:25.228406 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1ac6796a-fc92-4f8e-aaf3-4f1c417292d4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:25.237820 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1ac6796a-fc92-4f8e-aaf3-4f1c417292d4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.238871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1ac6796a-fc92-4f8e-aaf3-4f1c417292d4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.239984 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1ac6796a-fc92-4f8e-aaf3-4f1c417292d4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.240843 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1ac6796a-fc92-4f8e-aaf3-4f1c417292d4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.321308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f0506d22-63bf-408c-87ca-93d26b05d254 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:25.329928 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f0506d22-63bf-408c-87ca-93d26b05d254 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1512 microversion: 2.1 time: 0.125460 May 24 15:39:25.330507 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 111/204] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:25 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1512 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:25.693208 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1ac6796a-fc92-4f8e-aaf3-4f1c417292d4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:25.716260 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1ac6796a-fc92-4f8e-aaf3-4f1c417292d4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.513712 May 24 15:39:25.737027 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 94/205] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:25 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:25.805648 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b851f55e-0685-48e4-bfde-13f1d3ff7597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:25.806271 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b851f55e-0685-48e4-bfde-13f1d3ff7597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:25.815889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b851f55e-0685-48e4-bfde-13f1d3ff7597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.816637 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b851f55e-0685-48e4-bfde-13f1d3ff7597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.817595 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b851f55e-0685-48e4-bfde-13f1d3ff7597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:25.818821 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b851f55e-0685-48e4-bfde-13f1d3ff7597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:25.971061 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b851f55e-0685-48e4-bfde-13f1d3ff7597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:25.978869 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b851f55e-0685-48e4-bfde-13f1d3ff7597 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1503 microversion: 2.1 time: 0.179248 May 24 15:39:25.979566 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 112/206] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:25 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:26.347035 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ad1a5741-2bc7-41ba-88af-b211919391e8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:26.348005 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ad1a5741-2bc7-41ba-88af-b211919391e8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:26.360887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ad1a5741-2bc7-41ba-88af-b211919391e8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.361253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ad1a5741-2bc7-41ba-88af-b211919391e8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.362055 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ad1a5741-2bc7-41ba-88af-b211919391e8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.362547 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ad1a5741-2bc7-41ba-88af-b211919391e8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.433799 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ad1a5741-2bc7-41ba-88af-b211919391e8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f6a35cac50431d9468b51c9259bdb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86f8a870f9146489a3ef1716094e066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:26.443385 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ad1a5741-2bc7-41ba-88af-b211919391e8 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 200 len: 1346 microversion: 2.1 time: 0.100441 May 24 15:39:26.444260 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 95/207] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:26 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:26.735660 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f1b28a07-8ee7-4946-b85c-cfa11e5c0d04 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:26.737025 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f1b28a07-8ee7-4946-b85c-cfa11e5c0d04 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:26.746550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f1b28a07-8ee7-4946-b85c-cfa11e5c0d04 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.748195 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f1b28a07-8ee7-4946-b85c-cfa11e5c0d04 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.753027 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f1b28a07-8ee7-4946-b85c-cfa11e5c0d04 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.753619 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f1b28a07-8ee7-4946-b85c-cfa11e5c0d04 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.755038 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-d1cb8f12-c0c7-4d78-a8d7-75ff812817e5 req-618e0910-0bf7-4a1e-b777-21811a5b2d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47371c4c-744d-41c8-88ce-77c16bb4bbef", "name": "network-vif-deleted", "tag": "cf59e677-240a-4b1e-b4d1-2c5ed01afc57"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:26.767668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-d1cb8f12-c0c7-4d78-a8d7-75ff812817e5 req-618e0910-0bf7-4a1e-b777-21811a5b2d78 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:26.768315 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-d1cb8f12-c0c7-4d78-a8d7-75ff812817e5 req-618e0910-0bf7-4a1e-b777-21811a5b2d78 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:26.784243 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-d1cb8f12-c0c7-4d78-a8d7-75ff812817e5 req-618e0910-0bf7-4a1e-b777-21811a5b2d78 service nova] Creating event network-vif-deleted:cf59e677-240a-4b1e-b4d1-2c5ed01afc57 for instance 47371c4c-744d-41c8-88ce-77c16bb4bbef on hv-cinder-84315 May 24 15:39:26.791780 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-d1cb8f12-c0c7-4d78-a8d7-75ff812817e5 req-618e0910-0bf7-4a1e-b777-21811a5b2d78 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041617 May 24 15:39:26.792676 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 96/208] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:39:26.937733 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f1b28a07-8ee7-4946-b85c-cfa11e5c0d04 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:26.952811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f1b28a07-8ee7-4946-b85c-cfa11e5c0d04 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.223017 May 24 15:39:26.955588 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 113/209] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:26 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:26.998313 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-348b3388-d060-4c73-8b8a-5fe0d97c9abb tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:26.999827 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-348b3388-d060-4c73-8b8a-5fe0d97c9abb tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:27.012660 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-348b3388-d060-4c73-8b8a-5fe0d97c9abb tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.013109 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-348b3388-d060-4c73-8b8a-5fe0d97c9abb tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.016010 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-348b3388-d060-4c73-8b8a-5fe0d97c9abb tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.016753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-348b3388-d060-4c73-8b8a-5fe0d97c9abb tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.099758 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-348b3388-d060-4c73-8b8a-5fe0d97c9abb tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:27.111142 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-348b3388-d060-4c73-8b8a-5fe0d97c9abb tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 200 len: 1299 microversion: 2.1 time: 0.118216 May 24 15:39:27.121382 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 97/210] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:26 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:27.463810 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-778c1e61-e43b-458a-8018-f5ce38df6c96 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:27.464585 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-778c1e61-e43b-458a-8018-f5ce38df6c96 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:27.471056 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-778c1e61-e43b-458a-8018-f5ce38df6c96 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.471496 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-778c1e61-e43b-458a-8018-f5ce38df6c96 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.472276 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-778c1e61-e43b-458a-8018-f5ce38df6c96 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.472731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-778c1e61-e43b-458a-8018-f5ce38df6c96 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.487334 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-778c1e61-e43b-458a-8018-f5ce38df6c96 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] HTTP exception thrown: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-778c1e61-e43b-458a-8018-f5ce38df6c96 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Request method failure captured: May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 HTTP/1.1 May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPva82jdYPSHaOzZIajiXYMXtTcmscmM7o1soKTxRnUyQIp0023UXG624wSKXEAadkgklMevycVa7zXrCQWQn6vW1xUrdZvHBUa4OfrvnRZUBOn527K5cpDvkA0YG217_XmGc_Pk2rNZxEMvDLOtDoM0W3Wx75bETP8-wK9h5md-83E May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: f86f8a870f9146489a3ef1716094e066 May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-DeleteServersTestJSON-774158215 May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:39:27.499211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f86f8a870f9146489a3ef1716094e066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-DeleteServersTestJSON-774158215 May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: f86f8a870f9146489a3ef1716094e066 May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-DeleteServersTestJSON-774158215 May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-DeleteServersTestJSON-774158215-project May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: e9f6a35cac50431d9468b51c9259bdb5 May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-DeleteServersTestJSON-774158215-project May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:27.500902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'baac3150-841e-41d4-8408-93df2ec929c9'} May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:27.501695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:27.503042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:27.504267 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-778c1e61-e43b-458a-8018-f5ce38df6c96 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Returning 404 to user: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:27.504267 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-778c1e61-e43b-458a-8018-f5ce38df6c96 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 404 len: 111 microversion: 2.1 time: 0.041104 May 24 15:39:27.504267 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 114/211] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:27 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:39:27.652007 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4ec8a530-af37-437d-88f0-a13cdfcb012b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:27.653098 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4ec8a530-af37-437d-88f0-a13cdfcb012b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:27.660220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4ec8a530-af37-437d-88f0-a13cdfcb012b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.660743 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4ec8a530-af37-437d-88f0-a13cdfcb012b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.661590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4ec8a530-af37-437d-88f0-a13cdfcb012b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.662019 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4ec8a530-af37-437d-88f0-a13cdfcb012b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.667078 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:27.681388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-4ec8a530-af37-437d-88f0-a13cdfcb012b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] HTTP exception thrown: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4ec8a530-af37-437d-88f0-a13cdfcb012b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Request method failure captured: May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9/os-volume_attachments HTTP/1.1 May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPva82jdYPSHaOzZIajiXYMXtTcmscmM7o1soKTxRnUyQIp0023UXG624wSKXEAadkgklMevycVa7zXrCQWQn6vW1xUrdZvHBUa4OfrvnRZUBOn527K5cpDvkA0YG217_XmGc_Pk2rNZxEMvDLOtDoM0W3Wx75bETP8-wK9h5md-83E May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: f86f8a870f9146489a3ef1716094e066 May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-DeleteServersTestJSON-774158215 May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:39:27.686670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f86f8a870f9146489a3ef1716094e066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-DeleteServersTestJSON-774158215 May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: f86f8a870f9146489a3ef1716094e066 May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-DeleteServersTestJSON-774158215 May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-DeleteServersTestJSON-774158215-project May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: e9f6a35cac50431d9468b51c9259bdb5 May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-DeleteServersTestJSON-774158215-project May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:27.688244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'server_id': 'baac3150-841e-41d4-8408-93df2ec929c9'} May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:27.689121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:27.690381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:27.693788 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4ec8a530-af37-437d-88f0-a13cdfcb012b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Returning 404 to user: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:27.694909 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4ec8a530-af37-437d-88f0-a13cdfcb012b tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047558 May 24 15:39:27.695704 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 98/212] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:39:27 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:39:27.973989 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-851eee8e-5509-444a-b069-a318e4c3b331 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:27.973989 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-851eee8e-5509-444a-b069-a318e4c3b331 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:27.980110 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-851eee8e-5509-444a-b069-a318e4c3b331 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.980558 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-851eee8e-5509-444a-b069-a318e4c3b331 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:27.981312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-851eee8e-5509-444a-b069-a318e4c3b331 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:27.981736 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-851eee8e-5509-444a-b069-a318e4c3b331 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.128443 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a2059c7c-8ece-4363-9d95-60ff2992fbad tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:28.129098 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a2059c7c-8ece-4363-9d95-60ff2992fbad tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 47371c4c-744d-41c8-88ce-77c16bb4bbef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:28.139632 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a2059c7c-8ece-4363-9d95-60ff2992fbad tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.140246 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a2059c7c-8ece-4363-9d95-60ff2992fbad tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.141038 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a2059c7c-8ece-4363-9d95-60ff2992fbad tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.141668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a2059c7c-8ece-4363-9d95-60ff2992fbad tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.156144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-a2059c7c-8ece-4363-9d95-60ff2992fbad tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] HTTP exception thrown: Instance 47371c4c-744d-41c8-88ce-77c16bb4bbef could not be found. May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a2059c7c-8ece-4363-9d95-60ff2992fbad tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Request method failure captured: May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef HTTP/1.1 May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPv-UyCr7FYmaCtQBOx4ARJkc7FnToPkmOr24Gx---eUYN9joqAktzulLuOmIg1F29QzdkhQb_C3Bsi705P_6xYdrDOfkOhJw7zHxzGnWfh64cXH5_WWI3s64SfOdDZInKZRHxqGdvs7nPxShnClGE3RWNjTxgmByJx5FiF3vgLA0Xc May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: 80a3c5535f9040e58e055a7277514da1 May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-VolumesActionsTest-598608306 May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:39:28.158337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/80a3c5535f9040e58e055a7277514da1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_80a3c5535f9040e58e055a7277514da1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/80a3c5535f9040e58e055a7277514da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/80a3c5535f9040e58e055a7277514da1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-VolumesActionsTest-598608306 May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: 80a3c5535f9040e58e055a7277514da1 May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-VolumesActionsTest-598608306 May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-VolumesActionsTest-598608306-project May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0f0285314f124d228986e7f638833d04 May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-VolumesActionsTest-598608306-project May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance 47371c4c-744d-41c8-88ce-77c16bb4bbef could not be found. May 24 15:39:28.159564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': '47371c4c-744d-41c8-88ce-77c16bb4bbef'} May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47371c4c-744d-41c8-88ce-77c16bb4bbef could not be found. May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:28.160607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47371c4c-744d-41c8-88ce-77c16bb4bbef could not be found. May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47371c4c-744d-41c8-88ce-77c16bb4bbef could not be found. May 24 15:39:28.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:28.164859 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a2059c7c-8ece-4363-9d95-60ff2992fbad tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Returning 404 to user: Instance 47371c4c-744d-41c8-88ce-77c16bb4bbef could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:28.164859 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a2059c7c-8ece-4363-9d95-60ff2992fbad tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef" status: 404 len: 111 microversion: 2.1 time: 0.035355 May 24 15:39:28.164859 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 99/213] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:28 2022] GET /compute/v2.1/servers/47371c4c-744d-41c8-88ce-77c16bb4bbef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:39:28.203821 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-851eee8e-5509-444a-b069-a318e4c3b331 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:28.212514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-851eee8e-5509-444a-b069-a318e4c3b331 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.243917 May 24 15:39:28.213295 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 115/214] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:27 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:28.271440 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1758307363", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "networks": [{"uuid": "0bcc5330-fb8d-4ac5-8c91-fc8cafd86886"}]}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:28.338983 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] validate_networks() for [('0bcc5330-fb8d-4ac5-8c91-fc8cafd86886', None, None, None, None, None)] {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:39:28.848594 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:39:28.851512 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:39:28.852313 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:39:28.853205 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:39:28.853852 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:39:28.869356 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.871442 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.872671 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.873522 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.901625 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Getting quotas for project 80a3c5535f9040e58e055a7277514da1. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:39:28.907142 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Getting quotas for user 0f0285314f124d228986e7f638833d04 and project 80a3c5535f9040e58e055a7277514da1. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:39:28.927923 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:39:28.928834 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-89442d04-9c0f-40ef-8076-970c012933e9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:28.929401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-89442d04-9c0f-40ef-8076-970c012933e9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:28.930586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:39:28.931408 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=78 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:28.937354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-89442d04-9c0f-40ef-8076-970c012933e9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.937887 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-89442d04-9c0f-40ef-8076-970c012933e9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.938806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-89442d04-9c0f-40ef-8076-970c012933e9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.939537 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-89442d04-9c0f-40ef-8076-970c012933e9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.955918 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-89442d04-9c0f-40ef-8076-970c012933e9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] HTTP exception thrown: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-89442d04-9c0f-40ef-8076-970c012933e9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Request method failure captured: May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: DELETE /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 HTTP/1.1 May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPva82jdYPSHaOzZIajiXYMXtTcmscmM7o1soKTxRnUyQIp0023UXG624wSKXEAadkgklMevycVa7zXrCQWQn6vW1xUrdZvHBUa4OfrvnRZUBOn527K5cpDvkA0YG217_XmGc_Pk2rNZxEMvDLOtDoM0W3Wx75bETP8-wK9h5md-83E May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: f86f8a870f9146489a3ef1716094e066 May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-DeleteServersTestJSON-774158215 May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:39:28.958412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f86f8a870f9146489a3ef1716094e066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-DeleteServersTestJSON-774158215 May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: f86f8a870f9146489a3ef1716094e066 May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-DeleteServersTestJSON-774158215 May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-DeleteServersTestJSON-774158215-project May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: e9f6a35cac50431d9468b51c9259bdb5 May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-DeleteServersTestJSON-774158215-project May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:28.959726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'baac3150-841e-41d4-8408-93df2ec929c9'} May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:28.960425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:28.961472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:28.962658 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-89442d04-9c0f-40ef-8076-970c012933e9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Returning 404 to user: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:28.962658 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-89442d04-9c0f-40ef-8076-970c012933e9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "DELETE /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 404 len: 111 microversion: 2.1 time: 0.035498 May 24 15:39:28.962658 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 116/215] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:39:28 2022] DELETE /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:39:28.970410 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-75c2ad9a-777b-4103-988d-c691251903a9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:28.971094 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-75c2ad9a-777b-4103-988d-c691251903a9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] [instance: baac3150-841e-41d4-8408-93df2ec929c9] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:28.977192 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-75c2ad9a-777b-4103-988d-c691251903a9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.977794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-75c2ad9a-777b-4103-988d-c691251903a9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.978511 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-75c2ad9a-777b-4103-988d-c691251903a9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:28.979004 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-75c2ad9a-777b-4103-988d-c691251903a9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:28.982729 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d885359a-f4d1-4b20-8bb9-97aa6a9c8f1a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715348 May 24 15:39:28.983389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 100/216] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:39:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:39:28.993328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-350fc962-ac71-4e9f-ae75-3940411013c3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:28.994135 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-350fc962-ac71-4e9f-ae75-3940411013c3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:29.013047 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-75c2ad9a-777b-4103-988d-c691251903a9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] HTTP exception thrown: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-75c2ad9a-777b-4103-988d-c691251903a9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Request method failure captured: May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 HTTP/1.1 May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPva82jdYPSHaOzZIajiXYMXtTcmscmM7o1soKTxRnUyQIp0023UXG624wSKXEAadkgklMevycVa7zXrCQWQn6vW1xUrdZvHBUa4OfrvnRZUBOn527K5cpDvkA0YG217_XmGc_Pk2rNZxEMvDLOtDoM0W3Wx75bETP8-wK9h5md-83E May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: f86f8a870f9146489a3ef1716094e066 May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-DeleteServersTestJSON-774158215 May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:39:29.014571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f86f8a870f9146489a3ef1716094e066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f86f8a870f9146489a3ef1716094e066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-DeleteServersTestJSON-774158215 May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: f86f8a870f9146489a3ef1716094e066 May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-DeleteServersTestJSON-774158215 May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-DeleteServersTestJSON-774158215-project May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: e9f6a35cac50431d9468b51c9259bdb5 May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-DeleteServersTestJSON-774158215-project May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:29.015696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'baac3150-841e-41d4-8408-93df2ec929c9'} May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:29.016586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. May 24 15:39:29.018188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:29.019183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-75c2ad9a-777b-4103-988d-c691251903a9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] Returning 404 to user: Instance baac3150-841e-41d4-8408-93df2ec929c9 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:29.019183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-75c2ad9a-777b-4103-988d-c691251903a9 tempest-DeleteServersTestJSON-774158215 tempest-DeleteServersTestJSON-774158215-project] 10.222.0.55 "GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9" status: 404 len: 111 microversion: 2.1 time: 0.049955 May 24 15:39:29.019183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 117/217] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:28 2022] GET /compute/v2.1/servers/baac3150-841e-41d4-8408-93df2ec929c9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:39:29.091570 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-350fc962-ac71-4e9f-ae75-3940411013c3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:29.109079 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-350fc962-ac71-4e9f-ae75-3940411013c3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1214 microversion: 2.1 time: 0.119477 May 24 15:39:29.109669 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 101/218] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:28 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:29.229960 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b55f9998-49db-4956-b524-afe50e3bebfb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:29.230909 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b55f9998-49db-4956-b524-afe50e3bebfb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:29.237420 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b55f9998-49db-4956-b524-afe50e3bebfb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:29.238086 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b55f9998-49db-4956-b524-afe50e3bebfb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:29.238959 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b55f9998-49db-4956-b524-afe50e3bebfb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:29.239597 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b55f9998-49db-4956-b524-afe50e3bebfb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:29.437915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b55f9998-49db-4956-b524-afe50e3bebfb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:29.450553 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b55f9998-49db-4956-b524-afe50e3bebfb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.225146 May 24 15:39:29.451138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 118/219] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:29 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:30.127373 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-12091f23-040b-49e0-be36-2cab676d8887 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:30.128337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-12091f23-040b-49e0-be36-2cab676d8887 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:30.136121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12091f23-040b-49e0-be36-2cab676d8887 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:30.136931 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12091f23-040b-49e0-be36-2cab676d8887 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:30.138070 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12091f23-040b-49e0-be36-2cab676d8887 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:30.138767 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12091f23-040b-49e0-be36-2cab676d8887 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:30.208570 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-12091f23-040b-49e0-be36-2cab676d8887 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:30.217234 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-12091f23-040b-49e0-be36-2cab676d8887 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1218 microversion: 2.1 time: 0.094555 May 24 15:39:30.217873 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 102/220] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:30 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:30.468495 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-961573f2-674a-4e01-bbf9-03cd99b54522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:30.469091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-961573f2-674a-4e01-bbf9-03cd99b54522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:30.477495 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-961573f2-674a-4e01-bbf9-03cd99b54522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:30.478135 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-961573f2-674a-4e01-bbf9-03cd99b54522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:30.478996 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-961573f2-674a-4e01-bbf9-03cd99b54522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:30.479495 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-961573f2-674a-4e01-bbf9-03cd99b54522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:30.627085 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-961573f2-674a-4e01-bbf9-03cd99b54522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:30.635360 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-961573f2-674a-4e01-bbf9-03cd99b54522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.171879 May 24 15:39:30.636115 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 119/221] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:30 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:31.150754 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9f69ab5e-ce6f-49e3-9bb3-7b2ff756d530 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Action: 'create', calling method: .version_select at 0x7fb1d53b00d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-259567552", "metadata": {"Type": "work"}}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9f69ab5e-ce6f-49e3-9bb3-7b2ff756d530 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Request method failure captured: May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 121 May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPwykX4QIQ1FOTlOWwGOoxFMsP3-l8Il02lVRE4ZeA_hdIkBNiEJjkcu_TL7FKqkjgxx0gtpkiv-Qgmf4h9_nCLHhd6r5dW2mUat2bYKsoVnV_0pl36VNTCkBMvf1RKPg14fOSSiXNtuWMl72MjTYMwpncf1szISCHMH4Ky2GQEME1c May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:39:31.161518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 813b39c57d6f472e95596c21e972c20e May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-259567552", "metadata": {"Type": "work"}}} May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: May 24 15:39:31.162978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-259567552', 'metadata': {'Type': 'work'}}}} May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise error May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi '#$%' May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:31.164640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 15:39:31.166063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 15:39:31.167054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 15:39:31.167054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.167054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9f69ab5e-ce6f-49e3-9bb3-7b2ff756d530 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:31.167054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9f69ab5e-ce6f-49e3-9bb3-7b2ff756d530 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128761 May 24 15:39:31.167054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 103/222] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 24 15:39:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 15:39:31.172725 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fd9e7e11-c058-4531-9f52-9f350f476b4d tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Action: 'create', calling method: .version_select at 0x7fb1d4b02ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-319693753", "metadata": {"Type": "work"}}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fd9e7e11-c058-4531-9f52-9f350f476b4d tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Request method failure captured: May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 119 May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPwykX4QIQ1FOTlOWwGOoxFMsP3-l8Il02lVRE4ZeA_hdIkBNiEJjkcu_TL7FKqkjgxx0gtpkiv-Qgmf4h9_nCLHhd6r5dW2mUat2bYKsoVnV_0pl36VNTCkBMvf1RKPg14fOSSiXNtuWMl72MjTYMwpncf1szISCHMH4Ky2GQEME1c May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:39:31.176858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 813b39c57d6f472e95596c21e972c20e May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-319693753", "metadata": {"Type": "work"}}} May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: May 24 15:39:31.178215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-319693753', 'metadata': {'Type': 'work'}}}} May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise error May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi '0' May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:31.178922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 15:39:31.180159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 15:39:31.181204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 15:39:31.181204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.181204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fd9e7e11-c058-4531-9f52-9f350f476b4d tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:31.181204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fd9e7e11-c058-4531-9f52-9f350f476b4d tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009380 May 24 15:39:31.181204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 120/223] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 24 15:39:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 24 15:39:31.187223 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1a958294-0bce-4591-baa8-8a780727a056 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Action: 'create', calling method: .version_select at 0x7fb1d5241550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1309892566", "metadata": {"Type": "work"}}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1a958294-0bce-4591-baa8-8a780727a056 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Request method failure captured: May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 119 May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPwykX4QIQ1FOTlOWwGOoxFMsP3-l8Il02lVRE4ZeA_hdIkBNiEJjkcu_TL7FKqkjgxx0gtpkiv-Qgmf4h9_nCLHhd6r5dW2mUat2bYKsoVnV_0pl36VNTCkBMvf1RKPg14fOSSiXNtuWMl72MjTYMwpncf1szISCHMH4Ky2GQEME1c May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:39:31.190389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 813b39c57d6f472e95596c21e972c20e May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1309892566", "metadata": {"Type": "work"}}} May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: May 24 15:39:31.191736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1309892566', 'metadata': {'Type': 'work'}}}} May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise error May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi '' May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:31.192652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 15:39:31.194088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 15:39:31.195176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 15:39:31.195176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:31.195176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1a958294-0bce-4591-baa8-8a780727a056 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:31.195176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1a958294-0bce-4591-baa8-8a780727a056 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008252 May 24 15:39:31.195176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 104/224] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 24 15:39:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 15:39:31.200670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-9cd61ae1-f4c0-4b7b-81a7-9069e098a160 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Calling method '.version_select at 0x7fb1d4aa2ee0>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:31.228778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-9cd61ae1-f4c0-4b7b-81a7-9069e098a160 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] HTTP exception thrown: Volume tempest-invalid-2027134560 could not be found. May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-9cd61ae1-f4c0-4b7b-81a7-9069e098a160 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Request method failure captured: May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2027134560 HTTP/1.1 May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPwykX4QIQ1FOTlOWwGOoxFMsP3-l8Il02lVRE4ZeA_hdIkBNiEJjkcu_TL7FKqkjgxx0gtpkiv-Qgmf4h9_nCLHhd6r5dW2mUat2bYKsoVnV_0pl36VNTCkBMvf1RKPg14fOSSiXNtuWMl72MjTYMwpncf1szISCHMH4Ky2GQEME1c May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:39:31.231703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 813b39c57d6f472e95596c21e972c20e May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Volume tempest-invalid-2027134560 could not be found. May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'tempest-invalid-2027134560'} May 24 15:39:31.233190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2027134560 could not be found. (HTTP 404) (Request-ID: req-cf81d4b5-492a-4eb8-ad55-2a75c3c3b791) May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.234405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:39:31.235732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2027134560 could not be found. May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:39:31.237188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2027134560 could not be found. May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2027134560 could not be found. May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-9cd61ae1-f4c0-4b7b-81a7-9069e098a160 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Returning 404 to user: Volume tempest-invalid-2027134560 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-9cd61ae1-f4c0-4b7b-81a7-9069e098a160 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2027134560" status: 404 len: 99 microversion: 2.1 time: 0.036079 May 24 15:39:31.238842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 121/225] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 24 15:39:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2027134560 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 24 15:39:31.239752 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c43e97bd-74d5-4575-90a4-f63e85088d8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:31.239752 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c43e97bd-74d5-4575-90a4-f63e85088d8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:31.243406 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-80d899d3-51b1-4a04-932b-f3ea911d4252 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003646 May 24 15:39:31.243668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c43e97bd-74d5-4575-90a4-f63e85088d8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:31.244049 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 122/226] 10.222.0.55 () {58 vars in 1139 bytes} [Tue May 24 15:39:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 24 15:39:31.244183 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c43e97bd-74d5-4575-90a4-f63e85088d8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:31.244890 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c43e97bd-74d5-4575-90a4-f63e85088d8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:31.245317 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c43e97bd-74d5-4575-90a4-f63e85088d8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:31.252279 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0b39d43c-e88b-4c52-b9c8-6268bf49dd25 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003312 May 24 15:39:31.252950 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 123/227] 10.222.0.55 () {58 vars in 1136 bytes} [Tue May 24 15:39:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 24 15:39:31.260816 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cc69e2cb-d118-45ae-aff3-bfd0f9ad2a46 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Calling method '.version_select at 0x7fb1d6f943a0>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:31.294854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-cc69e2cb-d118-45ae-aff3-bfd0f9ad2a46 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] HTTP exception thrown: Volume 99e87cd4-6cf0-46ee-b980-37395701cce4 could not be found. May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cc69e2cb-d118-45ae-aff3-bfd0f9ad2a46 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Request method failure captured: May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: DELETE /compute/v2.1/os-volumes/99e87cd4-6cf0-46ee-b980-37395701cce4 HTTP/1.1 May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPwykX4QIQ1FOTlOWwGOoxFMsP3-l8Il02lVRE4ZeA_hdIkBNiEJjkcu_TL7FKqkjgxx0gtpkiv-Qgmf4h9_nCLHhd6r5dW2mUat2bYKsoVnV_0pl36VNTCkBMvf1RKPg14fOSSiXNtuWMl72MjTYMwpncf1szISCHMH4Ky2GQEME1c May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:39:31.296849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 813b39c57d6f472e95596c21e972c20e May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Volume 99e87cd4-6cf0-46ee-b980-37395701cce4 could not be found. May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '99e87cd4-6cf0-46ee-b980-37395701cce4'} May 24 15:39:31.298097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99e87cd4-6cf0-46ee-b980-37395701cce4 could not be found. (HTTP 404) (Request-ID: req-71e9aaed-c49f-4162-92d7-62102dd3b06c) May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.298832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 15:39:31.300696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99e87cd4-6cf0-46ee-b980-37395701cce4 could not be found. May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 15:39:31.302338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99e87cd4-6cf0-46ee-b980-37395701cce4 could not be found. May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99e87cd4-6cf0-46ee-b980-37395701cce4 could not be found. May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cc69e2cb-d118-45ae-aff3-bfd0f9ad2a46 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Returning 404 to user: Volume 99e87cd4-6cf0-46ee-b980-37395701cce4 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cc69e2cb-d118-45ae-aff3-bfd0f9ad2a46 tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/99e87cd4-6cf0-46ee-b980-37395701cce4" status: 404 len: 109 microversion: 2.1 time: 0.040862 May 24 15:39:31.303503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 124/228] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 24 15:39:31 2022] DELETE /compute/v2.1/os-volumes/99e87cd4-6cf0-46ee-b980-37395701cce4 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:39:31.308181 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d3fb7bb6-651c-4f1d-b786-3d7664480acd tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Calling method '.version_select at 0x7fb1d4aa2280>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:31.311708 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c43e97bd-74d5-4575-90a4-f63e85088d8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:31.320120 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c43e97bd-74d5-4575-90a4-f63e85088d8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1218 microversion: 2.1 time: 0.089356 May 24 15:39:31.320684 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 105/229] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:31 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:31.336470 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-d3fb7bb6-651c-4f1d-b786-3d7664480acd tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] HTTP exception thrown: Volume 48206fd9-f937-4901-a736-98c93e2ed900 could not be found. May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d3fb7bb6-651c-4f1d-b786-3d7664480acd tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Request method failure captured: May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/os-volumes/48206fd9-f937-4901-a736-98c93e2ed900 HTTP/1.1 May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPwykX4QIQ1FOTlOWwGOoxFMsP3-l8Il02lVRE4ZeA_hdIkBNiEJjkcu_TL7FKqkjgxx0gtpkiv-Qgmf4h9_nCLHhd6r5dW2mUat2bYKsoVnV_0pl36VNTCkBMvf1RKPg14fOSSiXNtuWMl72MjTYMwpncf1szISCHMH4Ky2GQEME1c May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:39:31.338401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/42166c9c0aae47cd8ed3570e71c4602a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 42166c9c0aae47cd8ed3570e71c4602a May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-VolumesNegativeTest-1813495983 May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 813b39c57d6f472e95596c21e972c20e May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-VolumesNegativeTest-1813495983-project May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Volume 48206fd9-f937-4901-a736-98c93e2ed900 could not be found. May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '48206fd9-f937-4901-a736-98c93e2ed900'} May 24 15:39:31.339788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48206fd9-f937-4901-a736-98c93e2ed900 could not be found. (HTTP 404) (Request-ID: req-000f93db-f409-47aa-92c3-fc1e7430f014) May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.340688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:39:31.341850 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48206fd9-f937-4901-a736-98c93e2ed900 could not be found. May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 15:39:31.342845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48206fd9-f937-4901-a736-98c93e2ed900 could not be found. May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48206fd9-f937-4901-a736-98c93e2ed900 could not be found. May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d3fb7bb6-651c-4f1d-b786-3d7664480acd tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] Returning 404 to user: Volume 48206fd9-f937-4901-a736-98c93e2ed900 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d3fb7bb6-651c-4f1d-b786-3d7664480acd tempest-VolumesNegativeTest-1813495983 tempest-VolumesNegativeTest-1813495983-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/48206fd9-f937-4901-a736-98c93e2ed900" status: 404 len: 109 microversion: 2.1 time: 0.035378 May 24 15:39:31.343840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 125/230] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:39:31 2022] GET /compute/v2.1/os-volumes/48206fd9-f937-4901-a736-98c93e2ed900 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:39:31.653187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-95e1a285-ab2e-4886-8033-553a16a647ca tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:31.653792 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-95e1a285-ab2e-4886-8033-553a16a647ca tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:31.660093 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-95e1a285-ab2e-4886-8033-553a16a647ca tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:31.660615 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-95e1a285-ab2e-4886-8033-553a16a647ca tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:31.661370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-95e1a285-ab2e-4886-8033-553a16a647ca tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:31.661830 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-95e1a285-ab2e-4886-8033-553a16a647ca tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:31.806336 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-95e1a285-ab2e-4886-8033-553a16a647ca tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:31.814171 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-95e1a285-ab2e-4886-8033-553a16a647ca tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.165377 May 24 15:39:31.814985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 106/231] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:31 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:32.337053 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-780d371f-4c47-4d09-850c-e6a2af94408b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:32.338262 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-780d371f-4c47-4d09-850c-e6a2af94408b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:32.347064 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-780d371f-4c47-4d09-850c-e6a2af94408b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.347613 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-780d371f-4c47-4d09-850c-e6a2af94408b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.348700 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-780d371f-4c47-4d09-850c-e6a2af94408b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.349127 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-780d371f-4c47-4d09-850c-e6a2af94408b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.418124 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-780d371f-4c47-4d09-850c-e6a2af94408b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:32.426760 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-780d371f-4c47-4d09-850c-e6a2af94408b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1210 microversion: 2.1 time: 0.092648 May 24 15:39:32.428246 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 126/232] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:32 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:32.834692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1d35467f-6b68-4491-9dab-be3ec84f9b72 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:32.835482 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1d35467f-6b68-4491-9dab-be3ec84f9b72 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:32.841062 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:32.853146 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1d35467f-6b68-4491-9dab-be3ec84f9b72 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.856058 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1d35467f-6b68-4491-9dab-be3ec84f9b72 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:32.857137 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1d35467f-6b68-4491-9dab-be3ec84f9b72 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:32.859409 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1d35467f-6b68-4491-9dab-be3ec84f9b72 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.028097 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1d35467f-6b68-4491-9dab-be3ec84f9b72 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:33.037160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1d35467f-6b68-4491-9dab-be3ec84f9b72 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1520 microversion: 2.1 time: 0.207351 May 24 15:39:33.037742 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 107/233] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:32 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:33.444468 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-01d763d2-d8a5-4549-9690-0014bab826d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:33.445014 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-01d763d2-d8a5-4549-9690-0014bab826d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:33.451401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01d763d2-d8a5-4549-9690-0014bab826d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:33.451906 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01d763d2-d8a5-4549-9690-0014bab826d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.452975 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01d763d2-d8a5-4549-9690-0014bab826d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:33.453526 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01d763d2-d8a5-4549-9690-0014bab826d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:33.517271 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-01d763d2-d8a5-4549-9690-0014bab826d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:33.525625 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-01d763d2-d8a5-4549-9690-0014bab826d2 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1274 microversion: 2.1 time: 0.084977 May 24 15:39:33.526389 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 127/234] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:33 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:34.055693 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9cf404cf-9a6a-4fb3-bba9-4abe0d2dc569 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:34.056567 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9cf404cf-9a6a-4fb3-bba9-4abe0d2dc569 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:34.071613 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9cf404cf-9a6a-4fb3-bba9-4abe0d2dc569 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.072083 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9cf404cf-9a6a-4fb3-bba9-4abe0d2dc569 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.072851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9cf404cf-9a6a-4fb3-bba9-4abe0d2dc569 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.073280 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9cf404cf-9a6a-4fb3-bba9-4abe0d2dc569 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.210380 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9cf404cf-9a6a-4fb3-bba9-4abe0d2dc569 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:34.218077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9cf404cf-9a6a-4fb3-bba9-4abe0d2dc569 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1500 microversion: 2.1 time: 0.166651 May 24 15:39:34.218647 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 108/235] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:34 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:34.234347 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-359ece86-31e9-4f0e-83c6-1cd6dfd889d8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:34.234979 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-359ece86-31e9-4f0e-83c6-1cd6dfd889d8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:34.241528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-359ece86-31e9-4f0e-83c6-1cd6dfd889d8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.241962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-359ece86-31e9-4f0e-83c6-1cd6dfd889d8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.242706 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-359ece86-31e9-4f0e-83c6-1cd6dfd889d8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.243126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-359ece86-31e9-4f0e-83c6-1cd6dfd889d8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.385094 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-359ece86-31e9-4f0e-83c6-1cd6dfd889d8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:34.392778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-359ece86-31e9-4f0e-83c6-1cd6dfd889d8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1515 microversion: 2.1 time: 0.162351 May 24 15:39:34.393381 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 128/236] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:34 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:34.544453 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6165b812-e2e5-48b1-8f2a-86364a39adb1 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:34.545281 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6165b812-e2e5-48b1-8f2a-86364a39adb1 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:34.552167 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6165b812-e2e5-48b1-8f2a-86364a39adb1 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.552962 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6165b812-e2e5-48b1-8f2a-86364a39adb1 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.553820 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6165b812-e2e5-48b1-8f2a-86364a39adb1 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:34.554454 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6165b812-e2e5-48b1-8f2a-86364a39adb1 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:34.637427 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6165b812-e2e5-48b1-8f2a-86364a39adb1 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:34.645628 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6165b812-e2e5-48b1-8f2a-86364a39adb1 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1274 microversion: 2.1 time: 0.106148 May 24 15:39:34.646179 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 109/237] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:34 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:35.670516 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f25adc77-5bec-4547-b202-97dfd7deea53 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:35.671317 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f25adc77-5bec-4547-b202-97dfd7deea53 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:35.678155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f25adc77-5bec-4547-b202-97dfd7deea53 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:35.678624 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f25adc77-5bec-4547-b202-97dfd7deea53 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:35.679359 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f25adc77-5bec-4547-b202-97dfd7deea53 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:35.679792 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f25adc77-5bec-4547-b202-97dfd7deea53 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:35.744897 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f25adc77-5bec-4547-b202-97dfd7deea53 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:35.754029 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f25adc77-5bec-4547-b202-97dfd7deea53 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1274 microversion: 2.1 time: 0.094792 May 24 15:39:35.754753 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 129/238] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:35 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:36.771074 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d92e777f-0efd-4466-addf-71e7da18bd28 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:36.771742 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d92e777f-0efd-4466-addf-71e7da18bd28 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:36.779388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d92e777f-0efd-4466-addf-71e7da18bd28 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.779888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d92e777f-0efd-4466-addf-71e7da18bd28 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.780674 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d92e777f-0efd-4466-addf-71e7da18bd28 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.781201 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d92e777f-0efd-4466-addf-71e7da18bd28 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.880592 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d92e777f-0efd-4466-addf-71e7da18bd28 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:36.883536 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7a732a8b-ac83-4fa7-b0d1-d33e9026ae45 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:36.884636 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7a732a8b-ac83-4fa7-b0d1-d33e9026ae45 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:36.894891 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d92e777f-0efd-4466-addf-71e7da18bd28 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1272 microversion: 2.1 time: 0.127358 May 24 15:39:36.897750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7a732a8b-ac83-4fa7-b0d1-d33e9026ae45 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.898189 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7a732a8b-ac83-4fa7-b0d1-d33e9026ae45 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.898948 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7a732a8b-ac83-4fa7-b0d1-d33e9026ae45 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:36.899369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7a732a8b-ac83-4fa7-b0d1-d33e9026ae45 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:36.904396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 110/239] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:36 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:36.923345 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-7a732a8b-ac83-4fa7-b0d1-d33e9026ae45 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'flavor' on Instance uuid 69fdd945-52b6-4e16-9cd0-06bf19fc5536 {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:39:37.050412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:37.082716 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7a732a8b-ac83-4fa7-b0d1-d33e9026ae45 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536/action" status: 200 len: 32 microversion: 2.1 time: 0.208700 May 24 15:39:37.088225 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 130/240] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:39:36 2022] POST /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:39:37.094754 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6a95917d-d5dc-4226-a6c1-50aa9604ba05 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:37.104561 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6a95917d-d5dc-4226-a6c1-50aa9604ba05 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:37.121645 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6a95917d-d5dc-4226-a6c1-50aa9604ba05 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:37.122598 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6a95917d-d5dc-4226-a6c1-50aa9604ba05 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:37.126040 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6a95917d-d5dc-4226-a6c1-50aa9604ba05 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:37.126692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6a95917d-d5dc-4226-a6c1-50aa9604ba05 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:37.503554 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6a95917d-d5dc-4226-a6c1-50aa9604ba05 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:37.511526 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6a95917d-d5dc-4226-a6c1-50aa9604ba05 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.421505 May 24 15:39:37.516433 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 111/241] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:37 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:37.925420 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8908841f-02cf-4869-a876-116b7003818e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:37.927197 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8908841f-02cf-4869-a876-116b7003818e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:37.937759 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8908841f-02cf-4869-a876-116b7003818e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:37.938223 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8908841f-02cf-4869-a876-116b7003818e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:37.938985 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8908841f-02cf-4869-a876-116b7003818e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:37.939516 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8908841f-02cf-4869-a876-116b7003818e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:38.062821 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-0a1fa6e1-a32f-49ee-bfd9-b5ad3f36b5b2 req-5c06d809-52da-4221-8400-347c0c3222f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128d6e73-6416-417f-96a1-3738761368e5", "tag": "ed9223d0-ec76-4da7-9bb3-b4613bbe3189"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:38.078009 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-0a1fa6e1-a32f-49ee-bfd9-b5ad3f36b5b2 req-5c06d809-52da-4221-8400-347c0c3222f2 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:38.078967 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-0a1fa6e1-a32f-49ee-bfd9-b5ad3f36b5b2 req-5c06d809-52da-4221-8400-347c0c3222f2 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:38.107921 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-0a1fa6e1-a32f-49ee-bfd9-b5ad3f36b5b2 req-5c06d809-52da-4221-8400-347c0c3222f2 service nova] Creating event network-changed:ed9223d0-ec76-4da7-9bb3-b4613bbe3189 for instance 128d6e73-6416-417f-96a1-3738761368e5 on hv-cinder-84315 May 24 15:39:38.130980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-0a1fa6e1-a32f-49ee-bfd9-b5ad3f36b5b2 req-5c06d809-52da-4221-8400-347c0c3222f2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071773 May 24 15:39:38.131933 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 112/242] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:39:38.184245 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8908841f-02cf-4869-a876-116b7003818e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:38.192562 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8908841f-02cf-4869-a876-116b7003818e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1314 microversion: 2.1 time: 0.271354 May 24 15:39:38.193198 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 131/243] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:37 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:38.529693 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d0947621-be44-4184-8724-be0977fce805 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:38.530396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d0947621-be44-4184-8724-be0977fce805 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:38.538071 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d0947621-be44-4184-8724-be0977fce805 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:38.538587 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d0947621-be44-4184-8724-be0977fce805 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:38.539514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d0947621-be44-4184-8724-be0977fce805 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:38.540061 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d0947621-be44-4184-8724-be0977fce805 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:38.678823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d0947621-be44-4184-8724-be0977fce805 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:38.693844 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d0947621-be44-4184-8724-be0977fce805 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.168493 May 24 15:39:38.694266 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 113/244] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:38 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:39.211208 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e8de4eb5-9343-4172-bc34-2741130e079c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:39.212486 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e8de4eb5-9343-4172-bc34-2741130e079c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:39.219221 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e8de4eb5-9343-4172-bc34-2741130e079c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:39.219681 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e8de4eb5-9343-4172-bc34-2741130e079c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.220729 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e8de4eb5-9343-4172-bc34-2741130e079c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:39.221358 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e8de4eb5-9343-4172-bc34-2741130e079c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.357073 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e8de4eb5-9343-4172-bc34-2741130e079c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:39.364661 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e8de4eb5-9343-4172-bc34-2741130e079c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1314 microversion: 2.1 time: 0.158638 May 24 15:39:39.365234 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 132/245] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:39 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:39.710927 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2e64bf0d-5292-4ad3-a038-8f7118d5083b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:39.712139 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2e64bf0d-5292-4ad3-a038-8f7118d5083b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:39.713781 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:39.714971 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=8 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:39.720503 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2e64bf0d-5292-4ad3-a038-8f7118d5083b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:39.720945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2e64bf0d-5292-4ad3-a038-8f7118d5083b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.721837 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2e64bf0d-5292-4ad3-a038-8f7118d5083b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:39.722312 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2e64bf0d-5292-4ad3-a038-8f7118d5083b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:39.859825 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2e64bf0d-5292-4ad3-a038-8f7118d5083b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:39.867608 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2e64bf0d-5292-4ad3-a038-8f7118d5083b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.160546 May 24 15:39:39.868729 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 114/246] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:39 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:40.381704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fc4c5548-d242-477f-b2de-60a7f047c36c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:40.382314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fc4c5548-d242-477f-b2de-60a7f047c36c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:40.390946 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fc4c5548-d242-477f-b2de-60a7f047c36c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.391386 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fc4c5548-d242-477f-b2de-60a7f047c36c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.392168 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fc4c5548-d242-477f-b2de-60a7f047c36c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.392750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fc4c5548-d242-477f-b2de-60a7f047c36c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.592760 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fc4c5548-d242-477f-b2de-60a7f047c36c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:40.602259 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fc4c5548-d242-477f-b2de-60a7f047c36c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1314 microversion: 2.1 time: 0.223886 May 24 15:39:40.603003 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 133/247] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:40 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:40.885077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-75fbfe47-9836-47a3-bc2f-7d262144d799 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:40.886371 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-75fbfe47-9836-47a3-bc2f-7d262144d799 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:40.895406 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75fbfe47-9836-47a3-bc2f-7d262144d799 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.895900 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75fbfe47-9836-47a3-bc2f-7d262144d799 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:40.896691 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75fbfe47-9836-47a3-bc2f-7d262144d799 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:40.897273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75fbfe47-9836-47a3-bc2f-7d262144d799 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:41.043409 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-75fbfe47-9836-47a3-bc2f-7d262144d799 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:41.053848 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-75fbfe47-9836-47a3-bc2f-7d262144d799 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.173163 May 24 15:39:41.054449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 115/248] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:40 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:41.618993 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d1f42e4f-5510-4f78-bfcf-1d5098071b8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:41.619699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d1f42e4f-5510-4f78-bfcf-1d5098071b8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:41.625582 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d1f42e4f-5510-4f78-bfcf-1d5098071b8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:41.626231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d1f42e4f-5510-4f78-bfcf-1d5098071b8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:41.626975 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d1f42e4f-5510-4f78-bfcf-1d5098071b8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:41.627558 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d1f42e4f-5510-4f78-bfcf-1d5098071b8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:41.783991 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d1f42e4f-5510-4f78-bfcf-1d5098071b8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:41.793870 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d1f42e4f-5510-4f78-bfcf-1d5098071b8c tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1314 microversion: 2.1 time: 0.178570 May 24 15:39:41.794659 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 134/249] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:41 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:42.073899 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c6deaa68-eb7b-4f36-938b-1236e8b2bd92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:42.075010 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c6deaa68-eb7b-4f36-938b-1236e8b2bd92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:42.097881 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c6deaa68-eb7b-4f36-938b-1236e8b2bd92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:42.098883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c6deaa68-eb7b-4f36-938b-1236e8b2bd92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.100366 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c6deaa68-eb7b-4f36-938b-1236e8b2bd92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:42.101245 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c6deaa68-eb7b-4f36-938b-1236e8b2bd92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.309042 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c6deaa68-eb7b-4f36-938b-1236e8b2bd92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:42.318925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c6deaa68-eb7b-4f36-938b-1236e8b2bd92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.251485 May 24 15:39:42.319954 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 116/250] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:42 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:42.812421 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3839fe6f-9463-4f79-8e37-9b1b81ffb677 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:42.813031 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3839fe6f-9463-4f79-8e37-9b1b81ffb677 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:42.819888 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3839fe6f-9463-4f79-8e37-9b1b81ffb677 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:42.820356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3839fe6f-9463-4f79-8e37-9b1b81ffb677 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.821120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3839fe6f-9463-4f79-8e37-9b1b81ffb677 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:42.821542 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3839fe6f-9463-4f79-8e37-9b1b81ffb677 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:42.957894 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3839fe6f-9463-4f79-8e37-9b1b81ffb677 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:42.968692 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3839fe6f-9463-4f79-8e37-9b1b81ffb677 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1314 microversion: 2.1 time: 0.157729 May 24 15:39:42.969306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 135/251] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:42 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:43.336425 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-622e766a-7e57-469b-b968-1458172d2abf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:43.336992 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-622e766a-7e57-469b-b968-1458172d2abf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:43.344979 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-622e766a-7e57-469b-b968-1458172d2abf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.345813 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-622e766a-7e57-469b-b968-1458172d2abf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.346893 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-622e766a-7e57-469b-b968-1458172d2abf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.347540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-622e766a-7e57-469b-b968-1458172d2abf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.520756 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-622e766a-7e57-469b-b968-1458172d2abf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:43.528560 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-622e766a-7e57-469b-b968-1458172d2abf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.196359 May 24 15:39:43.529131 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 117/252] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:43 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:43.930106 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-aac491aa-f89d-4223-a19e-c36b5b11defa req-cbb63c17-7c1d-495f-a809-81f880fc1bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128d6e73-6416-417f-96a1-3738761368e5", "name": "network-vif-plugged", "status": "completed", "tag": "ed9223d0-ec76-4da7-9bb3-b4613bbe3189"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:43.940014 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-aac491aa-f89d-4223-a19e-c36b5b11defa req-cbb63c17-7c1d-495f-a809-81f880fc1bdd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.940515 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-aac491aa-f89d-4223-a19e-c36b5b11defa req-cbb63c17-7c1d-495f-a809-81f880fc1bdd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.954721 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-aac491aa-f89d-4223-a19e-c36b5b11defa req-cbb63c17-7c1d-495f-a809-81f880fc1bdd service nova] Creating event network-vif-plugged:ed9223d0-ec76-4da7-9bb3-b4613bbe3189 for instance 128d6e73-6416-417f-96a1-3738761368e5 on hv-cinder-84315 May 24 15:39:43.960108 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-aac491aa-f89d-4223-a19e-c36b5b11defa req-cbb63c17-7c1d-495f-a809-81f880fc1bdd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033788 May 24 15:39:43.961055 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 136/253] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:39:43.985652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-10f1f1f7-5041-4675-8320-bdc2baec387b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:43.986510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-10f1f1f7-5041-4675-8320-bdc2baec387b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:43.992890 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-10f1f1f7-5041-4675-8320-bdc2baec387b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.993524 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-10f1f1f7-5041-4675-8320-bdc2baec387b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:43.994426 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-10f1f1f7-5041-4675-8320-bdc2baec387b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:43.995005 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-10f1f1f7-5041-4675-8320-bdc2baec387b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:44.154677 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-10f1f1f7-5041-4675-8320-bdc2baec387b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:44.165186 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-10f1f1f7-5041-4675-8320-bdc2baec387b tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1314 microversion: 2.1 time: 0.183270 May 24 15:39:44.165769 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 118/254] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:43 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:44.547969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-523cde94-ad35-418f-abaa-394e33f2ae8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:44.548686 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-523cde94-ad35-418f-abaa-394e33f2ae8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:44.556581 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-523cde94-ad35-418f-abaa-394e33f2ae8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:44.557018 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-523cde94-ad35-418f-abaa-394e33f2ae8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:44.558184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-523cde94-ad35-418f-abaa-394e33f2ae8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:44.558611 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-523cde94-ad35-418f-abaa-394e33f2ae8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:44.717373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-523cde94-ad35-418f-abaa-394e33f2ae8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:44.728635 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-523cde94-ad35-418f-abaa-394e33f2ae8b tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.185376 May 24 15:39:44.729508 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 137/255] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:44 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:39:45.182482 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-13216f9f-7fe2-4976-b695-695966e66256 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:45.183003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-13216f9f-7fe2-4976-b695-695966e66256 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:45.189611 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13216f9f-7fe2-4976-b695-695966e66256 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.190092 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13216f9f-7fe2-4976-b695-695966e66256 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.191022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13216f9f-7fe2-4976-b695-695966e66256 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.191509 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13216f9f-7fe2-4976-b695-695966e66256 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.326591 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-13216f9f-7fe2-4976-b695-695966e66256 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:45.334992 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-13216f9f-7fe2-4976-b695-695966e66256 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1314 microversion: 2.1 time: 0.156315 May 24 15:39:45.335624 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 119/256] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:45 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:45.750414 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f0d55b2e-c2e7-4e20-b4d4-3b2201930b1e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:45.751309 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f0d55b2e-c2e7-4e20-b4d4-3b2201930b1e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:45.762544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f0d55b2e-c2e7-4e20-b4d4-3b2201930b1e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.763284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f0d55b2e-c2e7-4e20-b4d4-3b2201930b1e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.764597 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f0d55b2e-c2e7-4e20-b4d4-3b2201930b1e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:45.765313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f0d55b2e-c2e7-4e20-b4d4-3b2201930b1e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:45.904010 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f0d55b2e-c2e7-4e20-b4d4-3b2201930b1e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:45.912188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f0d55b2e-c2e7-4e20-b4d4-3b2201930b1e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.168332 May 24 15:39:45.912751 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 138/257] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:45 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:46.353276 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7e26d0f4-d58a-4c07-ba45-9899ab39b0aa tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:46.353883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7e26d0f4-d58a-4c07-ba45-9899ab39b0aa tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:46.360480 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7e26d0f4-d58a-4c07-ba45-9899ab39b0aa tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:46.360915 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7e26d0f4-d58a-4c07-ba45-9899ab39b0aa tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:46.361666 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7e26d0f4-d58a-4c07-ba45-9899ab39b0aa tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:46.362094 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7e26d0f4-d58a-4c07-ba45-9899ab39b0aa tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:46.378010 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=100 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:46.570457 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7e26d0f4-d58a-4c07-ba45-9899ab39b0aa tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:46.579209 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7e26d0f4-d58a-4c07-ba45-9899ab39b0aa tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1498 microversion: 2.1 time: 0.229753 May 24 15:39:46.580175 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 120/258] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:46 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1498 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:46.930233 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7d5cc37c-37c6-4d06-9c18-a6cd90f24342 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:46.930954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7d5cc37c-37c6-4d06-9c18-a6cd90f24342 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:46.940530 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7d5cc37c-37c6-4d06-9c18-a6cd90f24342 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:46.941106 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7d5cc37c-37c6-4d06-9c18-a6cd90f24342 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:46.942145 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7d5cc37c-37c6-4d06-9c18-a6cd90f24342 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:46.943971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7d5cc37c-37c6-4d06-9c18-a6cd90f24342 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.189925 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7d5cc37c-37c6-4d06-9c18-a6cd90f24342 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:47.198734 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7d5cc37c-37c6-4d06-9c18-a6cd90f24342 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.274123 May 24 15:39:47.199500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 139/259] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:46 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:47.396141 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f6706793-5274-4820-8bda-fb26fa4b05af tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:47.396767 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f6706793-5274-4820-8bda-fb26fa4b05af tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:47.408619 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f6706793-5274-4820-8bda-fb26fa4b05af tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.409203 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f6706793-5274-4820-8bda-fb26fa4b05af tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.410142 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f6706793-5274-4820-8bda-fb26fa4b05af tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.410731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f6706793-5274-4820-8bda-fb26fa4b05af tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.457417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f6706793-5274-4820-8bda-fb26fa4b05af tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:39:47.622614 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f6706793-5274-4820-8bda-fb26fa4b05af tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "DELETE /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 204 len: 0 microversion: 2.1 time: 0.228667 May 24 15:39:47.625277 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 121/260] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:39:47 2022] DELETE /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:39:47.639702 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a5a15a3d-4d8b-40f9-b924-61ba79896987 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:47.640698 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a5a15a3d-4d8b-40f9-b924-61ba79896987 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:47.654486 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a5a15a3d-4d8b-40f9-b924-61ba79896987 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.655628 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a5a15a3d-4d8b-40f9-b924-61ba79896987 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.656572 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a5a15a3d-4d8b-40f9-b924-61ba79896987 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:47.657259 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a5a15a3d-4d8b-40f9-b924-61ba79896987 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:47.931581 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a5a15a3d-4d8b-40f9-b924-61ba79896987 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:47.939120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a5a15a3d-4d8b-40f9-b924-61ba79896987 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1504 microversion: 2.1 time: 0.305004 May 24 15:39:47.939681 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 140/261] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:47 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:48.217344 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4b3f38d4-fc90-41dd-8fe0-603386e8ac42 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:48.218032 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4b3f38d4-fc90-41dd-8fe0-603386e8ac42 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:48.224600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4b3f38d4-fc90-41dd-8fe0-603386e8ac42 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.225059 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4b3f38d4-fc90-41dd-8fe0-603386e8ac42 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:48.225881 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4b3f38d4-fc90-41dd-8fe0-603386e8ac42 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.226345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4b3f38d4-fc90-41dd-8fe0-603386e8ac42 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:48.374605 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4b3f38d4-fc90-41dd-8fe0-603386e8ac42 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:48.383715 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4b3f38d4-fc90-41dd-8fe0-603386e8ac42 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.170295 May 24 15:39:48.384344 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 122/262] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:48 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:48.957569 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-12a027e5-fe62-4adb-8e94-7e14f8e88741 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:48.958190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-12a027e5-fe62-4adb-8e94-7e14f8e88741 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:48.967111 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12a027e5-fe62-4adb-8e94-7e14f8e88741 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.967646 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12a027e5-fe62-4adb-8e94-7e14f8e88741 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:48.968450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12a027e5-fe62-4adb-8e94-7e14f8e88741 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:48.969009 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12a027e5-fe62-4adb-8e94-7e14f8e88741 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:49.130263 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-12a027e5-fe62-4adb-8e94-7e14f8e88741 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:49.139308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-12a027e5-fe62-4adb-8e94-7e14f8e88741 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1504 microversion: 2.1 time: 0.186676 May 24 15:39:49.144108 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 141/263] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:48 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:49.400996 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-48982b3f-6026-4c78-85be-79dc71002461 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:49.401617 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-48982b3f-6026-4c78-85be-79dc71002461 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:49.408822 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-48982b3f-6026-4c78-85be-79dc71002461 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:49.409365 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-48982b3f-6026-4c78-85be-79dc71002461 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:49.410309 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-48982b3f-6026-4c78-85be-79dc71002461 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:49.410744 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-48982b3f-6026-4c78-85be-79dc71002461 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:49.547144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-48982b3f-6026-4c78-85be-79dc71002461 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:49.555139 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-48982b3f-6026-4c78-85be-79dc71002461 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.158245 May 24 15:39:49.555709 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 123/264] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:49 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:50.156321 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0b872c3c-ca7e-4ad7-a741-beb3cc470ac3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:50.156919 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0b872c3c-ca7e-4ad7-a741-beb3cc470ac3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:50.162896 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0b872c3c-ca7e-4ad7-a741-beb3cc470ac3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:50.163328 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0b872c3c-ca7e-4ad7-a741-beb3cc470ac3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:50.164139 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0b872c3c-ca7e-4ad7-a741-beb3cc470ac3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:50.164543 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0b872c3c-ca7e-4ad7-a741-beb3cc470ac3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:50.296148 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0b872c3c-ca7e-4ad7-a741-beb3cc470ac3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:50.303742 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0b872c3c-ca7e-4ad7-a741-beb3cc470ac3 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1504 microversion: 2.1 time: 0.151263 May 24 15:39:50.304354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 142/265] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:50 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:50.572629 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6efdcccc-9d68-41de-8979-90b0b180b982 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:50.573798 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6efdcccc-9d68-41de-8979-90b0b180b982 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:50.580578 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6efdcccc-9d68-41de-8979-90b0b180b982 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:50.581261 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6efdcccc-9d68-41de-8979-90b0b180b982 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:50.582353 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6efdcccc-9d68-41de-8979-90b0b180b982 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:50.582934 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6efdcccc-9d68-41de-8979-90b0b180b982 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:50.715430 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6efdcccc-9d68-41de-8979-90b0b180b982 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:50.723357 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6efdcccc-9d68-41de-8979-90b0b180b982 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.154624 May 24 15:39:50.723896 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 124/266] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:50 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:51.321503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7b055075-ce4c-4b7b-8da0-1ec98bebe87e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:51.322146 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7b055075-ce4c-4b7b-8da0-1ec98bebe87e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:51.328737 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7b055075-ce4c-4b7b-8da0-1ec98bebe87e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.329175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7b055075-ce4c-4b7b-8da0-1ec98bebe87e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.329926 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7b055075-ce4c-4b7b-8da0-1ec98bebe87e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.330351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7b055075-ce4c-4b7b-8da0-1ec98bebe87e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.465871 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7b055075-ce4c-4b7b-8da0-1ec98bebe87e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:51.474257 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7b055075-ce4c-4b7b-8da0-1ec98bebe87e tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1504 microversion: 2.1 time: 0.157231 May 24 15:39:51.474802 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 143/267] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:51 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:51.740831 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-475ddd2d-4a76-48b6-a1bf-d0496a3bda71 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:51.741584 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-475ddd2d-4a76-48b6-a1bf-d0496a3bda71 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:51.748155 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-475ddd2d-4a76-48b6-a1bf-d0496a3bda71 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.748596 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-475ddd2d-4a76-48b6-a1bf-d0496a3bda71 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.749353 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-475ddd2d-4a76-48b6-a1bf-d0496a3bda71 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.749786 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-475ddd2d-4a76-48b6-a1bf-d0496a3bda71 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.875799 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-670aa17c-d3b0-4d1b-bbf1-f28eee8836c7 req-07df14f7-0299-4563-ac5f-fa62deb5e3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128d6e73-6416-417f-96a1-3738761368e5", "name": "network-vif-deleted", "tag": "ed9223d0-ec76-4da7-9bb3-b4613bbe3189"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:51.884637 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-670aa17c-d3b0-4d1b-bbf1-f28eee8836c7 req-07df14f7-0299-4563-ac5f-fa62deb5e3fd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:51.885069 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-670aa17c-d3b0-4d1b-bbf1-f28eee8836c7 req-07df14f7-0299-4563-ac5f-fa62deb5e3fd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:51.886862 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-475ddd2d-4a76-48b6-a1bf-d0496a3bda71 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:51.895951 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-475ddd2d-4a76-48b6-a1bf-d0496a3bda71 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.159238 May 24 15:39:51.896565 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 125/268] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:51 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:51.900925 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-670aa17c-d3b0-4d1b-bbf1-f28eee8836c7 req-07df14f7-0299-4563-ac5f-fa62deb5e3fd service nova] Creating event network-vif-deleted:ed9223d0-ec76-4da7-9bb3-b4613bbe3189 for instance 128d6e73-6416-417f-96a1-3738761368e5 on hv-cinder-84315 May 24 15:39:51.906047 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-670aa17c-d3b0-4d1b-bbf1-f28eee8836c7 req-07df14f7-0299-4563-ac5f-fa62deb5e3fd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033913 May 24 15:39:51.906883 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 144/269] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:39:52.331085 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-dd0a67c9-a03f-41ec-bfe1-33fcb794985b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:52.331675 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-dd0a67c9-a03f-41ec-bfe1-33fcb794985b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:52.339627 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd0a67c9-a03f-41ec-bfe1-33fcb794985b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.340063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd0a67c9-a03f-41ec-bfe1-33fcb794985b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.340849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd0a67c9-a03f-41ec-bfe1-33fcb794985b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.341277 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd0a67c9-a03f-41ec-bfe1-33fcb794985b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.365528 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-dd0a67c9-a03f-41ec-bfe1-33fcb794985b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/ips" status: 200 len: 150 microversion: 2.20 time: 0.038555 May 24 15:39:52.366112 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 126/270] 10.222.0.55 () {60 vars in 1288 bytes} [Tue May 24 15:39:52 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:39:52.494081 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-21ec6b50-6032-4f60-a2f6-3cf54a61ee3a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:52.495711 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-21ec6b50-6032-4f60-a2f6-3cf54a61ee3a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:52.504652 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21ec6b50-6032-4f60-a2f6-3cf54a61ee3a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.505173 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21ec6b50-6032-4f60-a2f6-3cf54a61ee3a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.505966 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21ec6b50-6032-4f60-a2f6-3cf54a61ee3a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.506385 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21ec6b50-6032-4f60-a2f6-3cf54a61ee3a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.578522 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-21ec6b50-6032-4f60-a2f6-3cf54a61ee3a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0285314f124d228986e7f638833d04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a3c5535f9040e58e055a7277514da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:52.586276 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-21ec6b50-6032-4f60-a2f6-3cf54a61ee3a tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 200 len: 1299 microversion: 2.1 time: 0.097608 May 24 15:39:52.587376 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 145/271] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:52 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:52.913577 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4dce0f0d-587d-4362-a943-9e2dc43ce01e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:52.914209 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4dce0f0d-587d-4362-a943-9e2dc43ce01e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:52.920845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4dce0f0d-587d-4362-a943-9e2dc43ce01e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.921471 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4dce0f0d-587d-4362-a943-9e2dc43ce01e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:52.922372 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4dce0f0d-587d-4362-a943-9e2dc43ce01e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:52.922798 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4dce0f0d-587d-4362-a943-9e2dc43ce01e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:53.088496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4dce0f0d-587d-4362-a943-9e2dc43ce01e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:53.096477 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4dce0f0d-587d-4362-a943-9e2dc43ce01e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.186809 May 24 15:39:53.097080 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 127/272] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:52 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:53.602862 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a9ed4aa9-830f-4eec-ad06-de50e38dee42 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:53.603447 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a9ed4aa9-830f-4eec-ad06-de50e38dee42 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] [instance: 128d6e73-6416-417f-96a1-3738761368e5] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:53.609779 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a9ed4aa9-830f-4eec-ad06-de50e38dee42 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:53.610228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a9ed4aa9-830f-4eec-ad06-de50e38dee42 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:53.610979 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a9ed4aa9-830f-4eec-ad06-de50e38dee42 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:53.611406 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a9ed4aa9-830f-4eec-ad06-de50e38dee42 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:53.625067 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-a9ed4aa9-830f-4eec-ad06-de50e38dee42 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] HTTP exception thrown: Instance 128d6e73-6416-417f-96a1-3738761368e5 could not be found. May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a9ed4aa9-830f-4eec-ad06-de50e38dee42 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Request method failure captured: May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 HTTP/1.1 May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPv-UyCr7FYmaCtQBOx4ARJkc7FnToPkmOr24Gx---eUYN9joqAktzulLuOmIg1F29QzdkhQb_C3Bsi705P_6xYdrDOfkOhJw7zHxzGnWfh64cXH5_WWI3s64SfOdDZInKZRHxqGdvs7nPxShnClGE3RWNjTxgmByJx5FiF3vgLA0Xc May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 80a3c5535f9040e58e055a7277514da1 May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-VolumesActionsTest-598608306 May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:39:53.626704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/80a3c5535f9040e58e055a7277514da1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_80a3c5535f9040e58e055a7277514da1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/80a3c5535f9040e58e055a7277514da1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/80a3c5535f9040e58e055a7277514da1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-VolumesActionsTest-598608306 May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 80a3c5535f9040e58e055a7277514da1 May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-VolumesActionsTest-598608306 May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-VolumesActionsTest-598608306-project May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 0f0285314f124d228986e7f638833d04 May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-VolumesActionsTest-598608306-project May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 128d6e73-6416-417f-96a1-3738761368e5 could not be found. May 24 15:39:53.628291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '128d6e73-6416-417f-96a1-3738761368e5'} May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 128d6e73-6416-417f-96a1-3738761368e5 could not be found. May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:53.629082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 128d6e73-6416-417f-96a1-3738761368e5 could not be found. May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 128d6e73-6416-417f-96a1-3738761368e5 could not be found. May 24 15:39:53.630222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:39:53.631279 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a9ed4aa9-830f-4eec-ad06-de50e38dee42 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] Returning 404 to user: Instance 128d6e73-6416-417f-96a1-3738761368e5 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:53.631279 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a9ed4aa9-830f-4eec-ad06-de50e38dee42 tempest-VolumesActionsTest-598608306 tempest-VolumesActionsTest-598608306-project] 10.222.0.55 "GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5" status: 404 len: 111 microversion: 2.1 time: 0.029073 May 24 15:39:53.631279 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 146/273] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:53 2022] GET /compute/v2.1/servers/128d6e73-6416-417f-96a1-3738761368e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:39:54.116717 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2a24c512-d8f9-4f57-96e8-973bd56f4e97 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:54.118019 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2a24c512-d8f9-4f57-96e8-973bd56f4e97 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:54.124462 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2a24c512-d8f9-4f57-96e8-973bd56f4e97 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:54.125116 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2a24c512-d8f9-4f57-96e8-973bd56f4e97 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:54.126112 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2a24c512-d8f9-4f57-96e8-973bd56f4e97 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:54.126547 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2a24c512-d8f9-4f57-96e8-973bd56f4e97 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:54.303970 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2a24c512-d8f9-4f57-96e8-973bd56f4e97 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:54.312833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2a24c512-d8f9-4f57-96e8-973bd56f4e97 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.200296 May 24 15:39:54.313405 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 128/274] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:54 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:55.331360 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-11bc19c7-5efe-4572-8890-60dba2ce3445 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:55.332830 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-11bc19c7-5efe-4572-8890-60dba2ce3445 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:55.339185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-11bc19c7-5efe-4572-8890-60dba2ce3445 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.339717 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-11bc19c7-5efe-4572-8890-60dba2ce3445 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.340588 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-11bc19c7-5efe-4572-8890-60dba2ce3445 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.341098 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-11bc19c7-5efe-4572-8890-60dba2ce3445 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.486179 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-11bc19c7-5efe-4572-8890-60dba2ce3445 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:55.493941 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-11bc19c7-5efe-4572-8890-60dba2ce3445 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1501 microversion: 2.1 time: 0.167095 May 24 15:39:55.494504 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 147/275] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:55 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:55.511634 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6f9e23cf-83e6-4c62-8cc5-9c6b6890f537 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71fc0a3c-713b-45f7-a5ac-f68ca34fb293"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:55.512749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6f9e23cf-83e6-4c62-8cc5-9c6b6890f537 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:55.519438 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6f9e23cf-83e6-4c62-8cc5-9c6b6890f537 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.519886 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6f9e23cf-83e6-4c62-8cc5-9c6b6890f537 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.520702 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6f9e23cf-83e6-4c62-8cc5-9c6b6890f537 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.521122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6f9e23cf-83e6-4c62-8cc5-9c6b6890f537 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.544381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-6f9e23cf-83e6-4c62-8cc5-9c6b6890f537 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] HTTP exception thrown: Cannot 'attach_volume' instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 while it is in vm_state rescued May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6f9e23cf-83e6-4c62-8cc5-9c6b6890f537 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Request method failure captured: May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: POST /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536/os-volume_attachments HTTP/1.1 May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 74 May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPvlT08falb-kbxErhnH4y_YxizG-iXi7Na5jtycP_ZDumNGA-LHP5Tl6lKn2dWP3vNAS8YgpJpxxPPoLUw_y5zCzNXpLx-D48XlgwdXZ_qVCv6JBhiW29zgII-w90Qp5k2SHhtWG5PB3Fp9pK6GeYy1i1bySozFoQa1X8Er2a4uxu8 May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: e280d545f6064b5c91289a77e2491511 May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:39:55.546103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e280d545f6064b5c91289a77e2491511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e280d545f6064b5c91289a77e2491511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e280d545f6064b5c91289a77e2491511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e280d545f6064b5c91289a77e2491511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: e280d545f6064b5c91289a77e2491511 May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-ServerRescueNegativeTestJSON-2086104122-project May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 6d07884e92bc4cfe95d2fd99c40f25f0 May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086104122-project May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {"volumeAttachment": {"volumeId": "71fc0a3c-713b-45f7-a5ac-f68ca34fb293"}} May 24 15:39:55.547369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Cannot 'attach_volume' instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 while it is in vm_state rescued May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'server_id': '69fdd945-52b6-4e16-9cd0-06bf19fc5536', 'body': {'volumeAttachment': {'volumeId': '71fc0a3c-713b-45f7-a5ac-f68ca34fb293'}}} May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:39:55.548077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 while it is in vm_state rescued May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:39:55.549096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:39:55.550241 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:39:55.550241 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:39:55.550241 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 while it is in vm_state rescued May 24 15:39:55.550241 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:39:55.550241 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6f9e23cf-83e6-4c62-8cc5-9c6b6890f537 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Returning 409 to user: Cannot 'attach_volume' instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 while it is in vm_state rescued {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:39:55.550241 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6f9e23cf-83e6-4c62-8cc5-9c6b6890f537 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040756 May 24 15:39:55.550241 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 129/276] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:39:55 2022] POST /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 15:39:55.556936 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-15417d0d-a3d9-4bb5-a11f-04eed2a9444a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:55.558331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-15417d0d-a3d9-4bb5-a11f-04eed2a9444a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:55.564650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-15417d0d-a3d9-4bb5-a11f-04eed2a9444a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.565092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-15417d0d-a3d9-4bb5-a11f-04eed2a9444a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.565954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-15417d0d-a3d9-4bb5-a11f-04eed2a9444a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.566569 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-15417d0d-a3d9-4bb5-a11f-04eed2a9444a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.605335 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:55.654328 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-15417d0d-a3d9-4bb5-a11f-04eed2a9444a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536/action" status: 202 len: 0 microversion: 2.1 time: 0.091228 May 24 15:39:55.656455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 148/277] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:39:55 2022] POST /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:39:55.671823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7b0bb99e-728a-44a5-9ef5-7c7ffd3e692c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:55.675755 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7b0bb99e-728a-44a5-9ef5-7c7ffd3e692c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:55.700474 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b0bb99e-728a-44a5-9ef5-7c7ffd3e692c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.701801 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b0bb99e-728a-44a5-9ef5-7c7ffd3e692c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.702623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b0bb99e-728a-44a5-9ef5-7c7ffd3e692c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:55.703214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b0bb99e-728a-44a5-9ef5-7c7ffd3e692c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:55.937288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7b0bb99e-728a-44a5-9ef5-7c7ffd3e692c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:55.951257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7b0bb99e-728a-44a5-9ef5-7c7ffd3e692c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1509 microversion: 2.1 time: 0.291466 May 24 15:39:55.955659 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 130/278] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:55 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:56.973934 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c9688b40-74be-4f45-b23e-679dd92fbdc2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:56.974804 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c9688b40-74be-4f45-b23e-679dd92fbdc2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:56.982411 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c9688b40-74be-4f45-b23e-679dd92fbdc2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:56.983003 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c9688b40-74be-4f45-b23e-679dd92fbdc2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:56.983791 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c9688b40-74be-4f45-b23e-679dd92fbdc2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:56.984254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c9688b40-74be-4f45-b23e-679dd92fbdc2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:57.142835 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c9688b40-74be-4f45-b23e-679dd92fbdc2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:57.150883 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c9688b40-74be-4f45-b23e-679dd92fbdc2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1509 microversion: 2.1 time: 0.181727 May 24 15:39:57.151442 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 149/279] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:56 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:58.168698 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9a0d6371-1b7e-4989-be9d-fc0de9532235 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:58.169428 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9a0d6371-1b7e-4989-be9d-fc0de9532235 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:58.177055 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a0d6371-1b7e-4989-be9d-fc0de9532235 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.177489 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a0d6371-1b7e-4989-be9d-fc0de9532235 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.178454 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a0d6371-1b7e-4989-be9d-fc0de9532235 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.178877 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a0d6371-1b7e-4989-be9d-fc0de9532235 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.319966 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9a0d6371-1b7e-4989-be9d-fc0de9532235 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:58.328633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9a0d6371-1b7e-4989-be9d-fc0de9532235 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1509 microversion: 2.1 time: 0.163871 May 24 15:39:58.329213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 131/280] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:58 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:58.364868 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-920414f4-58ac-49ca-beea-3c91c88e2484 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:39:58.365500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-920414f4-58ac-49ca-beea-3c91c88e2484 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:58.373869 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-920414f4-58ac-49ca-beea-3c91c88e2484 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.374312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-920414f4-58ac-49ca-beea-3c91c88e2484 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.375080 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-920414f4-58ac-49ca-beea-3c91c88e2484 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.375500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-920414f4-58ac-49ca-beea-3c91c88e2484 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.398294 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-920414f4-58ac-49ca-beea-3c91c88e2484 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lazy-loading 'flavor' on Instance uuid ca2694ac-4a5e-4cfa-aaf8-877c8285148a {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:39:58.661690 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-920414f4-58ac-49ca-beea-3c91c88e2484 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "POST /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/action" status: 202 len: 0 microversion: 2.20 time: 0.300950 May 24 15:39:58.662289 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 150/281] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 24 15:39:58 2022] POST /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 15:39:58.671861 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bae1e659-6452-472a-8ab1-12e3f4a3f50a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:58.672491 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bae1e659-6452-472a-8ab1-12e3f4a3f50a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:58.678909 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bae1e659-6452-472a-8ab1-12e3f4a3f50a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.679404 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bae1e659-6452-472a-8ab1-12e3f4a3f50a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.680273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bae1e659-6452-472a-8ab1-12e3f4a3f50a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:58.680694 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bae1e659-6452-472a-8ab1-12e3f4a3f50a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:58.811776 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bae1e659-6452-472a-8ab1-12e3f4a3f50a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:58.822165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bae1e659-6452-472a-8ab1-12e3f4a3f50a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:58.823646 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bae1e659-6452-472a-8ab1-12e3f4a3f50a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:58.824855 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bae1e659-6452-472a-8ab1-12e3f4a3f50a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.158055 May 24 15:39:58.825605 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 132/282] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:39:58 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:39:59.345603 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7f3bca90-b6e0-47dd-bed7-4c0abc603c88 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:59.346364 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7f3bca90-b6e0-47dd-bed7-4c0abc603c88 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:59.348739 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=58 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:39:59.354418 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f3bca90-b6e0-47dd-bed7-4c0abc603c88 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.354873 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f3bca90-b6e0-47dd-bed7-4c0abc603c88 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.355610 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f3bca90-b6e0-47dd-bed7-4c0abc603c88 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.356256 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f3bca90-b6e0-47dd-bed7-4c0abc603c88 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.507554 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7f3bca90-b6e0-47dd-bed7-4c0abc603c88 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:39:59.516553 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7f3bca90-b6e0-47dd-bed7-4c0abc603c88 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1509 microversion: 2.1 time: 0.175157 May 24 15:39:59.517361 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 151/283] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:39:59 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:39:59.848182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f85f358e-1bb7-410c-846f-82b99286bbf0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:39:59.849175 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f85f358e-1bb7-410c-846f-82b99286bbf0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:39:59.860113 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f85f358e-1bb7-410c-846f-82b99286bbf0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.860885 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f85f358e-1bb7-410c-846f-82b99286bbf0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.862135 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f85f358e-1bb7-410c-846f-82b99286bbf0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:39:59.862990 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f85f358e-1bb7-410c-846f-82b99286bbf0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:39:59.996374 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f85f358e-1bb7-410c-846f-82b99286bbf0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:00.008282 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f85f358e-1bb7-410c-846f-82b99286bbf0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:00.010546 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f85f358e-1bb7-410c-846f-82b99286bbf0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:00.012282 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f85f358e-1bb7-410c-846f-82b99286bbf0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.170525 May 24 15:40:00.012937 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 133/284] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:39:59 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:00.534694 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-384ec567-c6f2-4170-86bb-b200e212a681 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:00.535379 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-384ec567-c6f2-4170-86bb-b200e212a681 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:00.541882 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-384ec567-c6f2-4170-86bb-b200e212a681 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:00.542355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-384ec567-c6f2-4170-86bb-b200e212a681 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:00.543107 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-384ec567-c6f2-4170-86bb-b200e212a681 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:00.543504 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-384ec567-c6f2-4170-86bb-b200e212a681 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:00.686463 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-384ec567-c6f2-4170-86bb-b200e212a681 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:00.695651 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-384ec567-c6f2-4170-86bb-b200e212a681 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1509 microversion: 2.1 time: 0.164489 May 24 15:40:00.696466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 152/285] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:00 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:01.031748 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d01afa9d-05eb-449d-9390-957cf1d086a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:01.032317 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d01afa9d-05eb-449d-9390-957cf1d086a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:01.039545 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d01afa9d-05eb-449d-9390-957cf1d086a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:01.039994 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d01afa9d-05eb-449d-9390-957cf1d086a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.040777 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d01afa9d-05eb-449d-9390-957cf1d086a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:01.041205 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d01afa9d-05eb-449d-9390-957cf1d086a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.173848 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d01afa9d-05eb-449d-9390-957cf1d086a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:01.182973 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d01afa9d-05eb-449d-9390-957cf1d086a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:01.184484 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d01afa9d-05eb-449d-9390-957cf1d086a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:01.185649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d01afa9d-05eb-449d-9390-957cf1d086a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.157971 May 24 15:40:01.186214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 134/286] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:01 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:01.717062 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7893442b-0acf-44c5-a4ae-289ace09d45d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:01.718003 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7893442b-0acf-44c5-a4ae-289ace09d45d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:01.725324 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7893442b-0acf-44c5-a4ae-289ace09d45d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:01.725761 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7893442b-0acf-44c5-a4ae-289ace09d45d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.726506 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7893442b-0acf-44c5-a4ae-289ace09d45d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:01.726932 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7893442b-0acf-44c5-a4ae-289ace09d45d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:01.860577 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7893442b-0acf-44c5-a4ae-289ace09d45d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:01.868422 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7893442b-0acf-44c5-a4ae-289ace09d45d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1509 microversion: 2.1 time: 0.155739 May 24 15:40:01.868985 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 153/287] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:01 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:02.204461 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-12fbe9b0-e954-4a06-b645-bc50842b09c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:02.205046 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-12fbe9b0-e954-4a06-b645-bc50842b09c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:02.212281 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12fbe9b0-e954-4a06-b645-bc50842b09c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.212721 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12fbe9b0-e954-4a06-b645-bc50842b09c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:02.214001 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12fbe9b0-e954-4a06-b645-bc50842b09c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.214603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12fbe9b0-e954-4a06-b645-bc50842b09c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:02.353665 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-12fbe9b0-e954-4a06-b645-bc50842b09c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:02.362163 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-12fbe9b0-e954-4a06-b645-bc50842b09c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:02.364720 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-12fbe9b0-e954-4a06-b645-bc50842b09c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:02.366088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-12fbe9b0-e954-4a06-b645-bc50842b09c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.165803 May 24 15:40:02.366967 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 135/288] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:02 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:02.887837 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7e5ca0d0-c162-4c77-a656-d200f321403a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:02.888436 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7e5ca0d0-c162-4c77-a656-d200f321403a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:02.897587 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e5ca0d0-c162-4c77-a656-d200f321403a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.899083 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e5ca0d0-c162-4c77-a656-d200f321403a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:02.900852 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e5ca0d0-c162-4c77-a656-d200f321403a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:02.901707 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e5ca0d0-c162-4c77-a656-d200f321403a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:03.068020 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7e5ca0d0-c162-4c77-a656-d200f321403a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:03.076193 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7e5ca0d0-c162-4c77-a656-d200f321403a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1515 microversion: 2.1 time: 0.193042 May 24 15:40:03.077018 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 154/289] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:02 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:03.390939 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0b47e3d1-c5cb-4c73-b228-506db73512c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:03.391582 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0b47e3d1-c5cb-4c73-b228-506db73512c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:03.394992 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:03.402775 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0b47e3d1-c5cb-4c73-b228-506db73512c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:03.403510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0b47e3d1-c5cb-4c73-b228-506db73512c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:03.404482 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0b47e3d1-c5cb-4c73-b228-506db73512c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:03.405414 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0b47e3d1-c5cb-4c73-b228-506db73512c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:03.412899 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:03.557234 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0b47e3d1-c5cb-4c73-b228-506db73512c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:03.567316 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0b47e3d1-c5cb-4c73-b228-506db73512c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:03.568869 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0b47e3d1-c5cb-4c73-b228-506db73512c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:03.570081 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0b47e3d1-c5cb-4c73-b228-506db73512c8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.183936 May 24 15:40:03.570643 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 136/290] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:03 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:04.459586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-5fda5da0-3a0b-4989-b595-81a53a53c296 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'create', calling method: .version_select at 0x7fb1d5e74040>, body: {"keypair": {"name": "tempest-keypair-114222139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlUrvEidhFDDj2OAgpW5qxrp1Ehaw/4SpPfjDmP/HPQbW7/M3pHcGnsy6/uq9AEQ+crE7ehI320UxUx/ps6cH8bva+q5yNEii433I6To5A9mFosFNdnppbEXc1R/M919A=="}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:04.473987 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-5fda5da0-3a0b-4989-b595-81a53a53c296 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Getting quotas for project e280d545f6064b5c91289a77e2491511. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:40:04.478069 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-5fda5da0-3a0b-4989-b595-81a53a53c296 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Getting quotas for user 6d07884e92bc4cfe95d2fd99c40f25f0 and project e280d545f6064b5c91289a77e2491511. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:40:04.505894 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-5fda5da0-3a0b-4989-b595-81a53a53c296 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050296 May 24 15:40:04.506772 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 155/291] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 24 15:40:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:40:04.588018 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a82e278e-1ecd-4ab7-8d17-71d70dfadf15 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:04.590267 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a82e278e-1ecd-4ab7-8d17-71d70dfadf15 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:04.597452 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a82e278e-1ecd-4ab7-8d17-71d70dfadf15 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:04.599126 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a82e278e-1ecd-4ab7-8d17-71d70dfadf15 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:04.600614 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a82e278e-1ecd-4ab7-8d17-71d70dfadf15 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:04.602089 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a82e278e-1ecd-4ab7-8d17-71d70dfadf15 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:04.872182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a82e278e-1ecd-4ab7-8d17-71d70dfadf15 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:04.883516 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a82e278e-1ecd-4ab7-8d17-71d70dfadf15 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:04.885461 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a82e278e-1ecd-4ab7-8d17-71d70dfadf15 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:04.886803 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a82e278e-1ecd-4ab7-8d17-71d70dfadf15 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.302628 May 24 15:40:04.887892 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 137/292] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:04 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:05.914304 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d6b2ac93-409a-4517-8251-73050228740f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:05.915562 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d6b2ac93-409a-4517-8251-73050228740f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:05.922576 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6b2ac93-409a-4517-8251-73050228740f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:05.923533 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6b2ac93-409a-4517-8251-73050228740f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:05.924760 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6b2ac93-409a-4517-8251-73050228740f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:05.925647 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6b2ac93-409a-4517-8251-73050228740f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:06.120364 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d6b2ac93-409a-4517-8251-73050228740f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:06.128732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d6b2ac93-409a-4517-8251-73050228740f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:06.130615 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d6b2ac93-409a-4517-8251-73050228740f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:06.131772 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d6b2ac93-409a-4517-8251-73050228740f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.222452 May 24 15:40:06.132526 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 156/293] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:05 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:06.161760 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-300247565", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1d908b4-0d57-4328-b5e8-f2842546189b"}], "security_groups": [{"name": "tempest-securitygroup--1324689433"}], "key_name": "tempest-keypair-114222139", "user_data": "}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:07.152921 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-709de088-9fad-4849-b834-c230f5502bbd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:07.154986 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-709de088-9fad-4849-b834-c230f5502bbd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:07.166304 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-709de088-9fad-4849-b834-c230f5502bbd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:07.167420 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-709de088-9fad-4849-b834-c230f5502bbd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:07.168316 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-709de088-9fad-4849-b834-c230f5502bbd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:07.169304 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-709de088-9fad-4849-b834-c230f5502bbd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:07.495610 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-709de088-9fad-4849-b834-c230f5502bbd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:07.514178 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-709de088-9fad-4849-b834-c230f5502bbd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:07.515750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-709de088-9fad-4849-b834-c230f5502bbd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:07.520000 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-709de088-9fad-4849-b834-c230f5502bbd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.373875 May 24 15:40:07.522035 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 157/294] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:07 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:08.540549 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1ac8bbf1-90f0-4800-bfbd-0615d8ac5d98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:08.542460 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1ac8bbf1-90f0-4800-bfbd-0615d8ac5d98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:08.548964 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1ac8bbf1-90f0-4800-bfbd-0615d8ac5d98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:08.549802 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1ac8bbf1-90f0-4800-bfbd-0615d8ac5d98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:08.550714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1ac8bbf1-90f0-4800-bfbd-0615d8ac5d98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:08.551199 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1ac8bbf1-90f0-4800-bfbd-0615d8ac5d98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:08.769621 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1ac8bbf1-90f0-4800-bfbd-0615d8ac5d98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:08.788826 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1ac8bbf1-90f0-4800-bfbd-0615d8ac5d98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:08.788826 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1ac8bbf1-90f0-4800-bfbd-0615d8ac5d98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:08.788826 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1ac8bbf1-90f0-4800-bfbd-0615d8ac5d98 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.252213 May 24 15:40:08.798790 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 158/295] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:08 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:09.805862 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b595c022-2dce-4c22-b56d-753330b8e253 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:09.806524 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b595c022-2dce-4c22-b56d-753330b8e253 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:09.813553 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b595c022-2dce-4c22-b56d-753330b8e253 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:09.816909 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b595c022-2dce-4c22-b56d-753330b8e253 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:09.818956 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b595c022-2dce-4c22-b56d-753330b8e253 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:09.819430 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b595c022-2dce-4c22-b56d-753330b8e253 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:09.867328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] validate_networks() for [('b1d908b4-0d57-4328-b5e8-f2842546189b', None, None, None, None, None)] {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:40:10.138039 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b595c022-2dce-4c22-b56d-753330b8e253 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:10.147066 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b595c022-2dce-4c22-b56d-753330b8e253 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:10.148812 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b595c022-2dce-4c22-b56d-753330b8e253 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:10.150481 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b595c022-2dce-4c22-b56d-753330b8e253 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.349345 May 24 15:40:10.151029 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 159/296] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:09 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:10.379228 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:40:10.379649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:40:10.380207 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:40:10.380854 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:40:10.384883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:40:10.393840 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:10.394286 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:10.395078 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:10.395617 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:10.413275 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Getting quotas for project e280d545f6064b5c91289a77e2491511. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:40:10.417187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Getting quotas for user 6d07884e92bc4cfe95d2fd99c40f25f0 and project e280d545f6064b5c91289a77e2491511. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:40:10.428909 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:40:10.431264 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:40:10.497925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0063e601-177a-43b1-b0dc-a8b88557e8d9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.340355 May 24 15:40:10.499182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 138/297] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:40:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 4342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:40:10.509858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-096bdcd1-4429-4512-81c3-9b5dd3b9c25e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:10.510833 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-096bdcd1-4429-4512-81c3-9b5dd3b9c25e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:10.712608 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-096bdcd1-4429-4512-81c3-9b5dd3b9c25e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:10.730358 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-096bdcd1-4429-4512-81c3-9b5dd3b9c25e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1244 microversion: 2.1 time: 0.224488 May 24 15:40:10.733295 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 160/298] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:10 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1244 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:11.171317 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f3d73271-1950-4782-aa74-a6b21653123d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:11.172657 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f3d73271-1950-4782-aa74-a6b21653123d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:11.186391 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3d73271-1950-4782-aa74-a6b21653123d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.188587 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3d73271-1950-4782-aa74-a6b21653123d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.190140 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3d73271-1950-4782-aa74-a6b21653123d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.194011 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3d73271-1950-4782-aa74-a6b21653123d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.454404 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f3d73271-1950-4782-aa74-a6b21653123d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:11.474521 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f3d73271-1950-4782-aa74-a6b21653123d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:11.476344 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f3d73271-1950-4782-aa74-a6b21653123d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:11.477711 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f3d73271-1950-4782-aa74-a6b21653123d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.310871 May 24 15:40:11.479653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 139/299] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:11 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:11.753373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7ce23548-f2f3-4aec-aaa4-89936dfeb4c7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:11.754453 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7ce23548-f2f3-4aec-aaa4-89936dfeb4c7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:11.763878 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7ce23548-f2f3-4aec-aaa4-89936dfeb4c7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.764630 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7ce23548-f2f3-4aec-aaa4-89936dfeb4c7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.765848 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7ce23548-f2f3-4aec-aaa4-89936dfeb4c7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:11.766609 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7ce23548-f2f3-4aec-aaa4-89936dfeb4c7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:11.841482 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7ce23548-f2f3-4aec-aaa4-89936dfeb4c7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:11.849271 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7ce23548-f2f3-4aec-aaa4-89936dfeb4c7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1296 microversion: 2.1 time: 0.101710 May 24 15:40:11.850231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 161/300] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:11 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:12.501726 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4d930802-6a7e-4719-80a6-102c3f1f0277 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:12.502990 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4d930802-6a7e-4719-80a6-102c3f1f0277 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:12.515302 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d930802-6a7e-4719-80a6-102c3f1f0277 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:12.516280 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d930802-6a7e-4719-80a6-102c3f1f0277 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:12.517959 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d930802-6a7e-4719-80a6-102c3f1f0277 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:12.518686 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d930802-6a7e-4719-80a6-102c3f1f0277 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:12.655095 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4d930802-6a7e-4719-80a6-102c3f1f0277 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:12.664152 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4d930802-6a7e-4719-80a6-102c3f1f0277 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:12.666046 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4d930802-6a7e-4719-80a6-102c3f1f0277 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:12.667314 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4d930802-6a7e-4719-80a6-102c3f1f0277 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.172387 May 24 15:40:12.668330 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 140/301] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:12 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:12.869400 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2c642bf3-1a95-4db1-8b28-06de05ec4a4e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:12.870004 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2c642bf3-1a95-4db1-8b28-06de05ec4a4e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:12.879000 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2c642bf3-1a95-4db1-8b28-06de05ec4a4e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:12.879591 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2c642bf3-1a95-4db1-8b28-06de05ec4a4e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:12.880740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2c642bf3-1a95-4db1-8b28-06de05ec4a4e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:12.881170 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2c642bf3-1a95-4db1-8b28-06de05ec4a4e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:12.948692 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2c642bf3-1a95-4db1-8b28-06de05ec4a4e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:12.956206 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2c642bf3-1a95-4db1-8b28-06de05ec4a4e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1296 microversion: 2.1 time: 0.093001 May 24 15:40:12.957119 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 162/302] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:12 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:13.689826 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b901fa1d-7e26-44d1-a33f-87dd57321346 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:13.690997 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b901fa1d-7e26-44d1-a33f-87dd57321346 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:13.698637 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b901fa1d-7e26-44d1-a33f-87dd57321346 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:13.699098 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b901fa1d-7e26-44d1-a33f-87dd57321346 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:13.699831 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b901fa1d-7e26-44d1-a33f-87dd57321346 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:13.700300 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b901fa1d-7e26-44d1-a33f-87dd57321346 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:13.831192 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b901fa1d-7e26-44d1-a33f-87dd57321346 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:13.843330 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b901fa1d-7e26-44d1-a33f-87dd57321346 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:13.845679 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b901fa1d-7e26-44d1-a33f-87dd57321346 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:13.847379 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b901fa1d-7e26-44d1-a33f-87dd57321346 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.163846 May 24 15:40:13.848248 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 141/303] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:13 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:13.974294 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7bca8445-6fce-4945-86de-2e42c14c8380 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:13.974881 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7bca8445-6fce-4945-86de-2e42c14c8380 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:13.981171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7bca8445-6fce-4945-86de-2e42c14c8380 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:13.981615 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7bca8445-6fce-4945-86de-2e42c14c8380 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:13.982365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7bca8445-6fce-4945-86de-2e42c14c8380 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:13.982796 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7bca8445-6fce-4945-86de-2e42c14c8380 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:14.043910 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7bca8445-6fce-4945-86de-2e42c14c8380 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:14.051472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7bca8445-6fce-4945-86de-2e42c14c8380 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1296 microversion: 2.1 time: 0.081417 May 24 15:40:14.052284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 163/304] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:13 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:14.867339 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b10ca443-5d42-4aa3-a374-d7990e63c7e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:14.868161 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b10ca443-5d42-4aa3-a374-d7990e63c7e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:14.876932 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b10ca443-5d42-4aa3-a374-d7990e63c7e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:14.877432 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b10ca443-5d42-4aa3-a374-d7990e63c7e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:14.878428 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b10ca443-5d42-4aa3-a374-d7990e63c7e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:14.878995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b10ca443-5d42-4aa3-a374-d7990e63c7e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.029894 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b10ca443-5d42-4aa3-a374-d7990e63c7e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:15.043699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b10ca443-5d42-4aa3-a374-d7990e63c7e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:15.045272 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b10ca443-5d42-4aa3-a374-d7990e63c7e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:15.046475 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b10ca443-5d42-4aa3-a374-d7990e63c7e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.183864 May 24 15:40:15.047030 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 142/305] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:14 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:15.068725 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a08cbac0-0cab-453b-851c-8ea4731e8e92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:15.069412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a08cbac0-0cab-453b-851c-8ea4731e8e92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:15.075846 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a08cbac0-0cab-453b-851c-8ea4731e8e92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:15.076365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a08cbac0-0cab-453b-851c-8ea4731e8e92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.077129 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a08cbac0-0cab-453b-851c-8ea4731e8e92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:15.077552 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a08cbac0-0cab-453b-851c-8ea4731e8e92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:15.142520 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a08cbac0-0cab-453b-851c-8ea4731e8e92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:15.145051 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:15.153569 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a08cbac0-0cab-453b-851c-8ea4731e8e92 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1304 microversion: 2.1 time: 0.088753 May 24 15:40:15.155055 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 164/306] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:15 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:16.065587 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-365bef09-113f-443b-bc9c-e1f023173646 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:16.066962 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-365bef09-113f-443b-bc9c-e1f023173646 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:16.074177 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-365bef09-113f-443b-bc9c-e1f023173646 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.074922 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-365bef09-113f-443b-bc9c-e1f023173646 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.075954 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-365bef09-113f-443b-bc9c-e1f023173646 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.076514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-365bef09-113f-443b-bc9c-e1f023173646 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.174854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-345ed365-01c1-4350-9629-27b07f5565a1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:16.176267 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-345ed365-01c1-4350-9629-27b07f5565a1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:16.193460 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-345ed365-01c1-4350-9629-27b07f5565a1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.193905 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-345ed365-01c1-4350-9629-27b07f5565a1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.195382 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-345ed365-01c1-4350-9629-27b07f5565a1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:16.196332 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-345ed365-01c1-4350-9629-27b07f5565a1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:16.433837 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-345ed365-01c1-4350-9629-27b07f5565a1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:16.443983 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-345ed365-01c1-4350-9629-27b07f5565a1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.274702 May 24 15:40:16.447025 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 165/307] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:16 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:16.451502 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-365bef09-113f-443b-bc9c-e1f023173646 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:16.461680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-365bef09-113f-443b-bc9c-e1f023173646 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:16.463453 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-365bef09-113f-443b-bc9c-e1f023173646 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:16.465024 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-365bef09-113f-443b-bc9c-e1f023173646 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.403903 May 24 15:40:16.466096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 143/308] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:16 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:16.967240 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-ce44dc18-22a1-4f84-848d-79202b4e8ff5 req-0133fdba-4ad2-4472-8e31-0889811278fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f726278-c770-47b5-86db-c95db49ba80f", "tag": "123b7faa-d212-4186-93a9-6e1d900b7f9c"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:16.995785 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-ce44dc18-22a1-4f84-848d-79202b4e8ff5 req-0133fdba-4ad2-4472-8e31-0889811278fd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.000900 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-ce44dc18-22a1-4f84-848d-79202b4e8ff5 req-0133fdba-4ad2-4472-8e31-0889811278fd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.025197 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-ce44dc18-22a1-4f84-848d-79202b4e8ff5 req-0133fdba-4ad2-4472-8e31-0889811278fd service nova] Creating event network-changed:123b7faa-d212-4186-93a9-6e1d900b7f9c for instance 3f726278-c770-47b5-86db-c95db49ba80f on hv-cinder-84315 May 24 15:40:17.034977 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-ce44dc18-22a1-4f84-848d-79202b4e8ff5 req-0133fdba-4ad2-4472-8e31-0889811278fd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071220 May 24 15:40:17.036359 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 166/309] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:40:17.462945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3f48dd87-d189-45e0-b733-721d625169b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:17.463531 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3f48dd87-d189-45e0-b733-721d625169b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:17.472798 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3f48dd87-d189-45e0-b733-721d625169b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.473247 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3f48dd87-d189-45e0-b733-721d625169b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.474042 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3f48dd87-d189-45e0-b733-721d625169b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.474505 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3f48dd87-d189-45e0-b733-721d625169b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.484363 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3b03c416-7342-4236-8725-69015b9805a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:17.486029 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3b03c416-7342-4236-8725-69015b9805a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:17.493554 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3b03c416-7342-4236-8725-69015b9805a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.494085 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3b03c416-7342-4236-8725-69015b9805a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.494912 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3b03c416-7342-4236-8725-69015b9805a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:17.495695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3b03c416-7342-4236-8725-69015b9805a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:17.697525 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-3f48dd87-d189-45e0-b733-721d625169b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:17.703521 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3b03c416-7342-4236-8725-69015b9805a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:17.707624 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3f48dd87-d189-45e0-b733-721d625169b7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.248341 May 24 15:40:17.712742 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3b03c416-7342-4236-8725-69015b9805a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:17.714891 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3b03c416-7342-4236-8725-69015b9805a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:17.716347 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3b03c416-7342-4236-8725-69015b9805a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.237151 May 24 15:40:17.717223 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 167/310] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:17 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:17.719369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 144/311] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:17 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:18.727513 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-12ab25f5-288a-4920-b6e6-a51426d03c1c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:18.728145 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-12ab25f5-288a-4920-b6e6-a51426d03c1c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:18.734741 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12ab25f5-288a-4920-b6e6-a51426d03c1c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.735186 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12ab25f5-288a-4920-b6e6-a51426d03c1c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.735947 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12ab25f5-288a-4920-b6e6-a51426d03c1c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.736128 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-17cad034-e035-4c7a-9fc2-e88d787d904c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:18.736557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12ab25f5-288a-4920-b6e6-a51426d03c1c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.736666 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-17cad034-e035-4c7a-9fc2-e88d787d904c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:18.743628 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-17cad034-e035-4c7a-9fc2-e88d787d904c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.744100 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-17cad034-e035-4c7a-9fc2-e88d787d904c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.744860 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-17cad034-e035-4c7a-9fc2-e88d787d904c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:18.745288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-17cad034-e035-4c7a-9fc2-e88d787d904c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:18.928549 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-12ab25f5-288a-4920-b6e6-a51426d03c1c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:18.931939 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-17cad034-e035-4c7a-9fc2-e88d787d904c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:18.936074 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-12ab25f5-288a-4920-b6e6-a51426d03c1c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.212629 May 24 15:40:18.936665 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 168/312] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:18 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:18.940237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-17cad034-e035-4c7a-9fc2-e88d787d904c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:18.941712 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-17cad034-e035-4c7a-9fc2-e88d787d904c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:18.942939 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-17cad034-e035-4c7a-9fc2-e88d787d904c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.210769 May 24 15:40:18.943477 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 145/313] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:18 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:19.953210 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-21e320d2-16e1-41ce-89b3-d80ded38f7b1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:19.953810 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-21e320d2-16e1-41ce-89b3-d80ded38f7b1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:19.960737 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21e320d2-16e1-41ce-89b3-d80ded38f7b1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.960994 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c17450ce-8b78-4765-b50b-4835c83607e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:19.961411 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21e320d2-16e1-41ce-89b3-d80ded38f7b1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:19.961811 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c17450ce-8b78-4765-b50b-4835c83607e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:19.962239 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21e320d2-16e1-41ce-89b3-d80ded38f7b1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.962739 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21e320d2-16e1-41ce-89b3-d80ded38f7b1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:19.968944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c17450ce-8b78-4765-b50b-4835c83607e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.969105 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c17450ce-8b78-4765-b50b-4835c83607e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:19.969887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c17450ce-8b78-4765-b50b-4835c83607e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:19.970541 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c17450ce-8b78-4765-b50b-4835c83607e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:20.393590 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-21e320d2-16e1-41ce-89b3-d80ded38f7b1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:20.397777 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c17450ce-8b78-4765-b50b-4835c83607e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:20.404113 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:20.405268 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-21e320d2-16e1-41ce-89b3-d80ded38f7b1 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.455666 May 24 15:40:20.406154 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 169/314] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:19 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:20.413671 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c17450ce-8b78-4765-b50b-4835c83607e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:20.415525 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c17450ce-8b78-4765-b50b-4835c83607e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:20.417003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c17450ce-8b78-4765-b50b-4835c83607e9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.459910 May 24 15:40:20.417561 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 146/315] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:19 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:21.425085 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0c63a798-9af5-40be-9df2-cc6e6d8271f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:21.425684 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0c63a798-9af5-40be-9df2-cc6e6d8271f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:21.437752 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-87a07153-ec6e-4e8b-8b5c-c56fcc2a38a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:21.438394 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-87a07153-ec6e-4e8b-8b5c-c56fcc2a38a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:21.440648 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=6 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:21.447118 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=6 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:21.453567 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-87a07153-ec6e-4e8b-8b5c-c56fcc2a38a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:21.454136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-87a07153-ec6e-4e8b-8b5c-c56fcc2a38a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:21.455067 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-87a07153-ec6e-4e8b-8b5c-c56fcc2a38a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:21.455583 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-87a07153-ec6e-4e8b-8b5c-c56fcc2a38a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:21.462173 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0c63a798-9af5-40be-9df2-cc6e6d8271f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:21.462756 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0c63a798-9af5-40be-9df2-cc6e6d8271f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:21.463741 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0c63a798-9af5-40be-9df2-cc6e6d8271f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:21.464284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0c63a798-9af5-40be-9df2-cc6e6d8271f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:21.679765 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0c63a798-9af5-40be-9df2-cc6e6d8271f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:21.692427 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-87a07153-ec6e-4e8b-8b5c-c56fcc2a38a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:21.703998 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0c63a798-9af5-40be-9df2-cc6e6d8271f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.275149 May 24 15:40:21.703998 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 170/316] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:21 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:21.716513 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-87a07153-ec6e-4e8b-8b5c-c56fcc2a38a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:21.718014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-87a07153-ec6e-4e8b-8b5c-c56fcc2a38a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:21.719207 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-87a07153-ec6e-4e8b-8b5c-c56fcc2a38a4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1742 microversion: 2.20 time: 0.287115 May 24 15:40:21.719760 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 147/317] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:21 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1742 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:22.710904 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ee7268da-f6d2-4291-9978-e4d88f95553f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:22.711593 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ee7268da-f6d2-4291-9978-e4d88f95553f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:22.718129 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ee7268da-f6d2-4291-9978-e4d88f95553f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.718794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ee7268da-f6d2-4291-9978-e4d88f95553f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.719643 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ee7268da-f6d2-4291-9978-e4d88f95553f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.719980 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ee7268da-f6d2-4291-9978-e4d88f95553f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.737665 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-89d06a42-e8ef-4151-9718-ffe0caf02871 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:22.738264 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-89d06a42-e8ef-4151-9718-ffe0caf02871 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:22.745346 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-89d06a42-e8ef-4151-9718-ffe0caf02871 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.745785 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-89d06a42-e8ef-4151-9718-ffe0caf02871 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.746541 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-89d06a42-e8ef-4151-9718-ffe0caf02871 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:22.746975 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-89d06a42-e8ef-4151-9718-ffe0caf02871 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:22.974070 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ee7268da-f6d2-4291-9978-e4d88f95553f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:22.990543 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-89d06a42-e8ef-4151-9718-ffe0caf02871 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:22.996204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ee7268da-f6d2-4291-9978-e4d88f95553f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.279371 May 24 15:40:23.000854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 171/318] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:22 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:23.002607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-89d06a42-e8ef-4151-9718-ffe0caf02871 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:23.004634 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-89d06a42-e8ef-4151-9718-ffe0caf02871 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:23.006073 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-89d06a42-e8ef-4151-9718-ffe0caf02871 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1742 microversion: 2.20 time: 0.272379 May 24 15:40:23.007129 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 148/319] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:22 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1742 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:24.018521 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8aa1820d-fa0c-410c-a3a9-8a586fb1fe38 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:24.019804 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8aa1820d-fa0c-410c-a3a9-8a586fb1fe38 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:24.026397 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-212e51e4-9521-4042-a613-6f689d62f35b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:24.027630 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-212e51e4-9521-4042-a613-6f689d62f35b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:24.042419 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-212e51e4-9521-4042-a613-6f689d62f35b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:24.043035 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-212e51e4-9521-4042-a613-6f689d62f35b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.043236 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8aa1820d-fa0c-410c-a3a9-8a586fb1fe38 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:24.044829 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-212e51e4-9521-4042-a613-6f689d62f35b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:24.045373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8aa1820d-fa0c-410c-a3a9-8a586fb1fe38 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.046430 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8aa1820d-fa0c-410c-a3a9-8a586fb1fe38 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:24.047117 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-212e51e4-9521-4042-a613-6f689d62f35b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.047755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8aa1820d-fa0c-410c-a3a9-8a586fb1fe38 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:24.290190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8aa1820d-fa0c-410c-a3a9-8a586fb1fe38 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:24.302968 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8aa1820d-fa0c-410c-a3a9-8a586fb1fe38 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.285772 May 24 15:40:24.312327 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 172/320] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:24 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:24.321322 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-212e51e4-9521-4042-a613-6f689d62f35b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:24.337185 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-212e51e4-9521-4042-a613-6f689d62f35b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:24.339938 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-212e51e4-9521-4042-a613-6f689d62f35b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:24.342529 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-212e51e4-9521-4042-a613-6f689d62f35b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.320212 May 24 15:40:24.344772 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 149/321] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:24 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:25.320118 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-864e5fce-ea54-4886-9fe7-568f0fda09a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:25.320699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-864e5fce-ea54-4886-9fe7-568f0fda09a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:25.326964 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-864e5fce-ea54-4886-9fe7-568f0fda09a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.327379 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-864e5fce-ea54-4886-9fe7-568f0fda09a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.328160 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-864e5fce-ea54-4886-9fe7-568f0fda09a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.328585 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-864e5fce-ea54-4886-9fe7-568f0fda09a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.363423 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5b7d4849-0138-459b-8b8e-34337d852687 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:25.364491 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5b7d4849-0138-459b-8b8e-34337d852687 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:25.370740 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5b7d4849-0138-459b-8b8e-34337d852687 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.371182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5b7d4849-0138-459b-8b8e-34337d852687 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.371939 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5b7d4849-0138-459b-8b8e-34337d852687 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:25.372476 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5b7d4849-0138-459b-8b8e-34337d852687 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:25.510079 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-864e5fce-ea54-4886-9fe7-568f0fda09a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:25.517601 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-864e5fce-ea54-4886-9fe7-568f0fda09a5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.201473 May 24 15:40:25.518184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 173/322] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:25 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:25.539638 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5b7d4849-0138-459b-8b8e-34337d852687 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:25.547999 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5b7d4849-0138-459b-8b8e-34337d852687 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:25.549475 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5b7d4849-0138-459b-8b8e-34337d852687 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:25.550650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5b7d4849-0138-459b-8b8e-34337d852687 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.191775 May 24 15:40:25.551224 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 150/323] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:25 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:26.537536 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ed02efda-e49d-48d5-97e1-df95de17b5c2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:26.538135 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ed02efda-e49d-48d5-97e1-df95de17b5c2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:26.546537 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ed02efda-e49d-48d5-97e1-df95de17b5c2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.547262 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ed02efda-e49d-48d5-97e1-df95de17b5c2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.548577 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ed02efda-e49d-48d5-97e1-df95de17b5c2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.549290 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ed02efda-e49d-48d5-97e1-df95de17b5c2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.569795 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4ba1b7c8-958e-4e93-93c1-de4e93be4a3b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:26.570438 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4ba1b7c8-958e-4e93-93c1-de4e93be4a3b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:26.577760 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4ba1b7c8-958e-4e93-93c1-de4e93be4a3b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.578498 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4ba1b7c8-958e-4e93-93c1-de4e93be4a3b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.579541 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4ba1b7c8-958e-4e93-93c1-de4e93be4a3b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.579975 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4ba1b7c8-958e-4e93-93c1-de4e93be4a3b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.766515 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ed02efda-e49d-48d5-97e1-df95de17b5c2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:26.781993 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ed02efda-e49d-48d5-97e1-df95de17b5c2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.249716 May 24 15:40:26.782812 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 174/324] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:26 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:26.793702 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4ba1b7c8-958e-4e93-93c1-de4e93be4a3b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:26.804273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4ba1b7c8-958e-4e93-93c1-de4e93be4a3b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:26.805785 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4ba1b7c8-958e-4e93-93c1-de4e93be4a3b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:26.807140 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4ba1b7c8-958e-4e93-93c1-de4e93be4a3b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.241970 May 24 15:40:26.807819 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 151/325] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:26 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:26.899823 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-55f67407-2e86-450e-a78a-a933085e1ece req-6137825d-13fd-4484-b613-a73763fac034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2694ac-4a5e-4cfa-aaf8-877c8285148a", "name": "network-vif-plugged", "status": "completed", "tag": "b4136280-42c5-46f1-8248-0dcb997d0277"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:26.915328 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-55f67407-2e86-450e-a78a-a933085e1ece req-6137825d-13fd-4484-b613-a73763fac034 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:26.916425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-55f67407-2e86-450e-a78a-a933085e1ece req-6137825d-13fd-4484-b613-a73763fac034 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:26.942013 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-55f67407-2e86-450e-a78a-a933085e1ece req-6137825d-13fd-4484-b613-a73763fac034 service nova] Creating event network-vif-plugged:b4136280-42c5-46f1-8248-0dcb997d0277 for instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a on hv-cinder-84315 May 24 15:40:26.951215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-55f67407-2e86-450e-a78a-a933085e1ece req-6137825d-13fd-4484-b613-a73763fac034 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059225 May 24 15:40:26.952551 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 175/326] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:40:27.800495 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7403eb32-4996-41a4-a46c-6d12de33b6ff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:27.801020 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7403eb32-4996-41a4-a46c-6d12de33b6ff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:27.808649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7403eb32-4996-41a4-a46c-6d12de33b6ff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:27.809108 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7403eb32-4996-41a4-a46c-6d12de33b6ff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:27.810065 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7403eb32-4996-41a4-a46c-6d12de33b6ff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:27.810508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7403eb32-4996-41a4-a46c-6d12de33b6ff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:27.827130 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-69b4603a-39da-4695-b680-f0a8a8dd9e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:27.828539 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-69b4603a-39da-4695-b680-f0a8a8dd9e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:27.836379 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-69b4603a-39da-4695-b680-f0a8a8dd9e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:27.837147 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-69b4603a-39da-4695-b680-f0a8a8dd9e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:27.838767 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-69b4603a-39da-4695-b680-f0a8a8dd9e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:27.839566 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-69b4603a-39da-4695-b680-f0a8a8dd9e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:28.133125 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7403eb32-4996-41a4-a46c-6d12de33b6ff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:28.152394 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7403eb32-4996-41a4-a46c-6d12de33b6ff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.353174 May 24 15:40:28.161378 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 152/327] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:27 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:28.174801 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-69b4603a-39da-4695-b680-f0a8a8dd9e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:28.190556 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-69b4603a-39da-4695-b680-f0a8a8dd9e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:28.192968 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-69b4603a-39da-4695-b680-f0a8a8dd9e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:28.195392 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-69b4603a-39da-4695-b680-f0a8a8dd9e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.372347 May 24 15:40:28.211166 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 176/328] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:27 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:28.229541 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-716348141", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "networks": [{"uuid": "d22bbbfe-aa37-4ce8-92c8-3aeb391d1750"}]}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:29.174015 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c2025256-3f0c-4d0f-8b85-ef574110ee4d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:29.174612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c2025256-3f0c-4d0f-8b85-ef574110ee4d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:29.184060 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c2025256-3f0c-4d0f-8b85-ef574110ee4d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.184586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c2025256-3f0c-4d0f-8b85-ef574110ee4d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.186868 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c2025256-3f0c-4d0f-8b85-ef574110ee4d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.187554 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c2025256-3f0c-4d0f-8b85-ef574110ee4d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.340411 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c2025256-3f0c-4d0f-8b85-ef574110ee4d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:29.354183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c2025256-3f0c-4d0f-8b85-ef574110ee4d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.184775 May 24 15:40:29.356134 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 177/329] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:29 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:29.361699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fd6170f5-5a28-4cc4-81a6-e3043c14f9b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:29.362750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fd6170f5-5a28-4cc4-81a6-e3043c14f9b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:29.365018 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:29.372002 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fd6170f5-5a28-4cc4-81a6-e3043c14f9b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.372932 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fd6170f5-5a28-4cc4-81a6-e3043c14f9b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.374091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fd6170f5-5a28-4cc4-81a6-e3043c14f9b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:29.374905 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fd6170f5-5a28-4cc4-81a6-e3043c14f9b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:29.550091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fd6170f5-5a28-4cc4-81a6-e3043c14f9b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:29.559462 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fd6170f5-5a28-4cc4-81a6-e3043c14f9b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:29.561843 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fd6170f5-5a28-4cc4-81a6-e3043c14f9b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:29.563319 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fd6170f5-5a28-4cc4-81a6-e3043c14f9b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.205826 May 24 15:40:29.564159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 178/330] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:29 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:30.373835 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a1b8fd4f-5076-4beb-8703-f866b5933fa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:30.374488 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a1b8fd4f-5076-4beb-8703-f866b5933fa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:30.380875 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a1b8fd4f-5076-4beb-8703-f866b5933fa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.382100 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a1b8fd4f-5076-4beb-8703-f866b5933fa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.383440 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a1b8fd4f-5076-4beb-8703-f866b5933fa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.385318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a1b8fd4f-5076-4beb-8703-f866b5933fa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.536682 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a1b8fd4f-5076-4beb-8703-f866b5933fa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:30.544505 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a1b8fd4f-5076-4beb-8703-f866b5933fa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.174480 May 24 15:40:30.545201 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 179/331] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:30 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:30.583005 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8c10f120-8a5f-463b-9fc0-e319a6cf210b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:30.583723 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8c10f120-8a5f-463b-9fc0-e319a6cf210b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:30.593413 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c10f120-8a5f-463b-9fc0-e319a6cf210b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.594317 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c10f120-8a5f-463b-9fc0-e319a6cf210b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.595479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c10f120-8a5f-463b-9fc0-e319a6cf210b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:30.596503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c10f120-8a5f-463b-9fc0-e319a6cf210b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:30.758617 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8c10f120-8a5f-463b-9fc0-e319a6cf210b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:30.766793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8c10f120-8a5f-463b-9fc0-e319a6cf210b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:30.768437 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8c10f120-8a5f-463b-9fc0-e319a6cf210b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:30.769682 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8c10f120-8a5f-463b-9fc0-e319a6cf210b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.191540 May 24 15:40:30.770479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 180/332] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:30 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:31.564013 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-aadee4f7-43d8-42ae-a738-917ff64febad tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:31.565364 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-aadee4f7-43d8-42ae-a738-917ff64febad tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:31.572137 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aadee4f7-43d8-42ae-a738-917ff64febad tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:31.572794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aadee4f7-43d8-42ae-a738-917ff64febad tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:31.573740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aadee4f7-43d8-42ae-a738-917ff64febad tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:31.574171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aadee4f7-43d8-42ae-a738-917ff64febad tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:31.734625 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-aadee4f7-43d8-42ae-a738-917ff64febad tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:31.746013 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-aadee4f7-43d8-42ae-a738-917ff64febad tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.185775 May 24 15:40:31.756063 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 181/333] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:31 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:31.787741 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fcc9f908-fd84-4f5e-bdd2-dc3d29814578 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:31.788443 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fcc9f908-fd84-4f5e-bdd2-dc3d29814578 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:31.794747 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fcc9f908-fd84-4f5e-bdd2-dc3d29814578 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:31.795249 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fcc9f908-fd84-4f5e-bdd2-dc3d29814578 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:31.796092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fcc9f908-fd84-4f5e-bdd2-dc3d29814578 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:31.796862 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fcc9f908-fd84-4f5e-bdd2-dc3d29814578 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:31.934113 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fcc9f908-fd84-4f5e-bdd2-dc3d29814578 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:31.936848 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=100 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:31.944800 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fcc9f908-fd84-4f5e-bdd2-dc3d29814578 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:31.946456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fcc9f908-fd84-4f5e-bdd2-dc3d29814578 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:31.947611 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fcc9f908-fd84-4f5e-bdd2-dc3d29814578 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.164192 May 24 15:40:31.948220 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 182/334] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:31 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:32.764352 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e88abb3a-bb54-4339-82d4-153519d3e916 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:32.765023 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e88abb3a-bb54-4339-82d4-153519d3e916 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:32.772077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e88abb3a-bb54-4339-82d4-153519d3e916 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:32.772811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e88abb3a-bb54-4339-82d4-153519d3e916 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:32.774230 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e88abb3a-bb54-4339-82d4-153519d3e916 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:32.774840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e88abb3a-bb54-4339-82d4-153519d3e916 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:32.934624 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e88abb3a-bb54-4339-82d4-153519d3e916 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:32.951211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e88abb3a-bb54-4339-82d4-153519d3e916 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.191878 May 24 15:40:32.953310 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 183/335] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:32 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:32.965721 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-02010017-d994-4421-8015-9704d40e82d1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:32.968849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-02010017-d994-4421-8015-9704d40e82d1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:32.979424 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02010017-d994-4421-8015-9704d40e82d1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:32.980212 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02010017-d994-4421-8015-9704d40e82d1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:32.981236 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02010017-d994-4421-8015-9704d40e82d1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:32.981863 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02010017-d994-4421-8015-9704d40e82d1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:33.159600 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-02010017-d994-4421-8015-9704d40e82d1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:33.168758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-02010017-d994-4421-8015-9704d40e82d1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:33.170611 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-02010017-d994-4421-8015-9704d40e82d1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:33.171991 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-02010017-d994-4421-8015-9704d40e82d1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.210321 May 24 15:40:33.172998 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 184/336] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:32 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:33.969794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0f0d9f4f-3eff-450c-bfd3-d4795a0b323d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:33.970496 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0f0d9f4f-3eff-450c-bfd3-d4795a0b323d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:33.977097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0f0d9f4f-3eff-450c-bfd3-d4795a0b323d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:33.977623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0f0d9f4f-3eff-450c-bfd3-d4795a0b323d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:33.978356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0f0d9f4f-3eff-450c-bfd3-d4795a0b323d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:33.978713 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0f0d9f4f-3eff-450c-bfd3-d4795a0b323d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:34.166951 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0f0d9f4f-3eff-450c-bfd3-d4795a0b323d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:34.173968 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0f0d9f4f-3eff-450c-bfd3-d4795a0b323d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.208407 May 24 15:40:34.183486 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 185/337] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:33 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:34.194236 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-701a9ddf-f015-4bb4-8519-259f5d685cef tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:34.194983 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-701a9ddf-f015-4bb4-8519-259f5d685cef tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:34.202469 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-701a9ddf-f015-4bb4-8519-259f5d685cef tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:34.203843 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-701a9ddf-f015-4bb4-8519-259f5d685cef tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:34.204854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-701a9ddf-f015-4bb4-8519-259f5d685cef tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:34.205482 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-701a9ddf-f015-4bb4-8519-259f5d685cef tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:34.336284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-701a9ddf-f015-4bb4-8519-259f5d685cef tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:34.344585 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-701a9ddf-f015-4bb4-8519-259f5d685cef tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:34.346123 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-701a9ddf-f015-4bb4-8519-259f5d685cef tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:34.347280 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-701a9ddf-f015-4bb4-8519-259f5d685cef tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.157842 May 24 15:40:34.347855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 186/338] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:34 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:35.190817 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b7892f9f-16ef-4407-acd7-209cd5decbf8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:35.192680 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b7892f9f-16ef-4407-acd7-209cd5decbf8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:35.200539 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b7892f9f-16ef-4407-acd7-209cd5decbf8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.201014 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b7892f9f-16ef-4407-acd7-209cd5decbf8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.201770 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b7892f9f-16ef-4407-acd7-209cd5decbf8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.202194 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b7892f9f-16ef-4407-acd7-209cd5decbf8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.376853 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b7892f9f-16ef-4407-acd7-209cd5decbf8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:35.391770 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b7892f9f-16ef-4407-acd7-209cd5decbf8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.202905 May 24 15:40:35.392651 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 187/339] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:35 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:35.399191 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-01949c1c-7452-4acc-9358-516916598df7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:35.405775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-01949c1c-7452-4acc-9358-516916598df7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:35.412577 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01949c1c-7452-4acc-9358-516916598df7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.429236 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01949c1c-7452-4acc-9358-516916598df7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.430448 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01949c1c-7452-4acc-9358-516916598df7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:35.430780 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01949c1c-7452-4acc-9358-516916598df7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:35.603323 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-01949c1c-7452-4acc-9358-516916598df7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:35.612383 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-01949c1c-7452-4acc-9358-516916598df7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:35.614034 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-01949c1c-7452-4acc-9358-516916598df7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:35.615311 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-01949c1c-7452-4acc-9358-516916598df7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.220402 May 24 15:40:35.616186 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 188/340] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:35 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:35.871405 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] validate_networks() for [('d22bbbfe-aa37-4ce8-92c8-3aeb391d1750', None, None, None, None, None)] {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:40:36.257394 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:40:36.257805 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:40:36.258266 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:40:36.258662 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:40:36.259058 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:40:36.261130 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:36.270084 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.270515 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.271298 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.271718 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.278772 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=98 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:36.289938 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Getting quotas for project 769f37bc94e24c3482bb039c5a6e7291. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:40:36.293621 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Getting quotas for user 8c940eba35194b8db4af6eaf2df8b135 and project 769f37bc94e24c3482bb039c5a6e7291. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:40:36.303899 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:40:36.306011 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:40:36.352104 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-99384064-9ee6-48e7-bac0-397514d4c800 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.126533 May 24 15:40:36.352740 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 153/341] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:40:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 8129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 15:40:36.362998 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f81d1c66-6592-4c79-8a3d-721369b17bd8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:36.363668 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f81d1c66-6592-4c79-8a3d-721369b17bd8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:36.410289 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c02a9964-bd93-457e-8396-99a9b2aa04a3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:36.410940 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c02a9964-bd93-457e-8396-99a9b2aa04a3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:36.419100 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c02a9964-bd93-457e-8396-99a9b2aa04a3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.419575 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c02a9964-bd93-457e-8396-99a9b2aa04a3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.419777 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f81d1c66-6592-4c79-8a3d-721369b17bd8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.420493 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c02a9964-bd93-457e-8396-99a9b2aa04a3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.421052 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c02a9964-bd93-457e-8396-99a9b2aa04a3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.427691 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f81d1c66-6592-4c79-8a3d-721369b17bd8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1218 microversion: 2.1 time: 0.068523 May 24 15:40:36.428260 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 189/342] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:36 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:36.561889 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c02a9964-bd93-457e-8396-99a9b2aa04a3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.569722 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c02a9964-bd93-457e-8396-99a9b2aa04a3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.164004 May 24 15:40:36.570284 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 154/343] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:36 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:36.635935 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-052adcbc-4e69-4fd5-bd05-c657a0211470 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:36.636560 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-052adcbc-4e69-4fd5-bd05-c657a0211470 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:36.642687 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-052adcbc-4e69-4fd5-bd05-c657a0211470 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.643121 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-052adcbc-4e69-4fd5-bd05-c657a0211470 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.643863 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-052adcbc-4e69-4fd5-bd05-c657a0211470 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:36.644305 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-052adcbc-4e69-4fd5-bd05-c657a0211470 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:36.784019 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-052adcbc-4e69-4fd5-bd05-c657a0211470 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.792051 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-052adcbc-4e69-4fd5-bd05-c657a0211470 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.793540 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-052adcbc-4e69-4fd5-bd05-c657a0211470 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:36.794682 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-052adcbc-4e69-4fd5-bd05-c657a0211470 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.163222 May 24 15:40:36.795258 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 190/344] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:36 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:37.448774 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2b87514d-3310-4c16-8b18-9452c2d73a82 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:37.449717 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2b87514d-3310-4c16-8b18-9452c2d73a82 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:37.459647 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2b87514d-3310-4c16-8b18-9452c2d73a82 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.460118 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2b87514d-3310-4c16-8b18-9452c2d73a82 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.460866 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2b87514d-3310-4c16-8b18-9452c2d73a82 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.461291 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2b87514d-3310-4c16-8b18-9452c2d73a82 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.522688 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2b87514d-3310-4c16-8b18-9452c2d73a82 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.530638 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2b87514d-3310-4c16-8b18-9452c2d73a82 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1222 microversion: 2.1 time: 0.088281 May 24 15:40:37.531182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 155/345] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:37 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:37.586150 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8b6b0bd4-713b-4ada-ac61-2d36066c6473 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:37.586760 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8b6b0bd4-713b-4ada-ac61-2d36066c6473 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:37.593261 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8b6b0bd4-713b-4ada-ac61-2d36066c6473 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.593702 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8b6b0bd4-713b-4ada-ac61-2d36066c6473 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.594457 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8b6b0bd4-713b-4ada-ac61-2d36066c6473 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.594882 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8b6b0bd4-713b-4ada-ac61-2d36066c6473 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.732703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8b6b0bd4-713b-4ada-ac61-2d36066c6473 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.743436 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8b6b0bd4-713b-4ada-ac61-2d36066c6473 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.160901 May 24 15:40:37.744182 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 191/346] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:37 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:37.817244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-27f5bf58-55f8-41f1-8fcf-df281c8cffe1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:37.817888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-27f5bf58-55f8-41f1-8fcf-df281c8cffe1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:37.824732 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27f5bf58-55f8-41f1-8fcf-df281c8cffe1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.825204 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27f5bf58-55f8-41f1-8fcf-df281c8cffe1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.825980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27f5bf58-55f8-41f1-8fcf-df281c8cffe1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:37.826460 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27f5bf58-55f8-41f1-8fcf-df281c8cffe1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:37.965713 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-27f5bf58-55f8-41f1-8fcf-df281c8cffe1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.973749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-27f5bf58-55f8-41f1-8fcf-df281c8cffe1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.975203 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-27f5bf58-55f8-41f1-8fcf-df281c8cffe1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:37.976392 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-27f5bf58-55f8-41f1-8fcf-df281c8cffe1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.165793 May 24 15:40:37.976948 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 156/347] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:37 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:38.547764 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-dff29c38-ece5-4224-8e6c-4b9843d8585f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:38.548705 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-dff29c38-ece5-4224-8e6c-4b9843d8585f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:38.555468 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dff29c38-ece5-4224-8e6c-4b9843d8585f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:38.555911 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dff29c38-ece5-4224-8e6c-4b9843d8585f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:38.556727 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dff29c38-ece5-4224-8e6c-4b9843d8585f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:38.557158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dff29c38-ece5-4224-8e6c-4b9843d8585f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:38.618967 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dff29c38-ece5-4224-8e6c-4b9843d8585f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:38.630557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-dff29c38-ece5-4224-8e6c-4b9843d8585f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1222 microversion: 2.1 time: 0.086342 May 24 15:40:38.631658 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 192/348] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:38 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:38.766025 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d69bae4c-1c3d-4474-82bf-e0c9df2e9762 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:38.766619 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d69bae4c-1c3d-4474-82bf-e0c9df2e9762 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:38.779199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d69bae4c-1c3d-4474-82bf-e0c9df2e9762 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:38.779199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d69bae4c-1c3d-4474-82bf-e0c9df2e9762 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:38.779987 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d69bae4c-1c3d-4474-82bf-e0c9df2e9762 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:38.780766 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d69bae4c-1c3d-4474-82bf-e0c9df2e9762 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:38.966985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d69bae4c-1c3d-4474-82bf-e0c9df2e9762 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:38.975522 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d69bae4c-1c3d-4474-82bf-e0c9df2e9762 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.215171 May 24 15:40:38.976133 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 157/349] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:38 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:38.999688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3a077a6f-c756-4347-89fb-68b7b943f31c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:39.000369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3a077a6f-c756-4347-89fb-68b7b943f31c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:39.008534 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3a077a6f-c756-4347-89fb-68b7b943f31c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.008903 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3a077a6f-c756-4347-89fb-68b7b943f31c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.009651 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3a077a6f-c756-4347-89fb-68b7b943f31c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.010078 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3a077a6f-c756-4347-89fb-68b7b943f31c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.179814 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3a077a6f-c756-4347-89fb-68b7b943f31c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:39.188955 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3a077a6f-c756-4347-89fb-68b7b943f31c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:39.190626 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3a077a6f-c756-4347-89fb-68b7b943f31c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:39.192216 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3a077a6f-c756-4347-89fb-68b7b943f31c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.197700 May 24 15:40:39.192965 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 193/350] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:38 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:39.648774 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7936986b-d9e7-4ccb-945b-b277ee523f66 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:39.650005 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7936986b-d9e7-4ccb-945b-b277ee523f66 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:39.657936 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7936986b-d9e7-4ccb-945b-b277ee523f66 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.658774 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7936986b-d9e7-4ccb-945b-b277ee523f66 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.660684 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7936986b-d9e7-4ccb-945b-b277ee523f66 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:39.661527 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7936986b-d9e7-4ccb-945b-b277ee523f66 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:39.769580 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7936986b-d9e7-4ccb-945b-b277ee523f66 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:39.794102 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7936986b-d9e7-4ccb-945b-b277ee523f66 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1214 microversion: 2.1 time: 0.150784 May 24 15:40:39.794701 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 158/351] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:39 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:39.992752 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-dbc31d95-165c-4195-88af-2e38f96c0079 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:39.994034 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-dbc31d95-165c-4195-88af-2e38f96c0079 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:40.001028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dbc31d95-165c-4195-88af-2e38f96c0079 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.001547 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dbc31d95-165c-4195-88af-2e38f96c0079 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.002467 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dbc31d95-165c-4195-88af-2e38f96c0079 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.008074 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dbc31d95-165c-4195-88af-2e38f96c0079 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.152502 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dbc31d95-165c-4195-88af-2e38f96c0079 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.160189 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-dbc31d95-165c-4195-88af-2e38f96c0079 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.171262 May 24 15:40:40.161647 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 194/352] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:39 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:40.211577 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6d05129a-5566-4ab9-8ce5-02ca8f143562 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:40.212316 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6d05129a-5566-4ab9-8ce5-02ca8f143562 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:40.224971 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6d05129a-5566-4ab9-8ce5-02ca8f143562 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.225597 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6d05129a-5566-4ab9-8ce5-02ca8f143562 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.226677 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6d05129a-5566-4ab9-8ce5-02ca8f143562 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.227192 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6d05129a-5566-4ab9-8ce5-02ca8f143562 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.402567 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6d05129a-5566-4ab9-8ce5-02ca8f143562 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.410752 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6d05129a-5566-4ab9-8ce5-02ca8f143562 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.412395 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6d05129a-5566-4ab9-8ce5-02ca8f143562 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.413553 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6d05129a-5566-4ab9-8ce5-02ca8f143562 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.206891 May 24 15:40:40.414411 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 159/353] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:40 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:40.814670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8f0eecc0-dd43-4a94-9712-dd4fed59bf0f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:40.815567 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8f0eecc0-dd43-4a94-9712-dd4fed59bf0f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:40.822326 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8f0eecc0-dd43-4a94-9712-dd4fed59bf0f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.822882 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8f0eecc0-dd43-4a94-9712-dd4fed59bf0f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.823689 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8f0eecc0-dd43-4a94-9712-dd4fed59bf0f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:40.824167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8f0eecc0-dd43-4a94-9712-dd4fed59bf0f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:40.904221 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8f0eecc0-dd43-4a94-9712-dd4fed59bf0f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:40.913345 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8f0eecc0-dd43-4a94-9712-dd4fed59bf0f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1270 microversion: 2.1 time: 0.102607 May 24 15:40:40.913911 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 195/354] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:40 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:41.178236 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5b438049-21b6-495f-8895-a5645d051354 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:41.179593 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5b438049-21b6-495f-8895-a5645d051354 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:41.186194 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5b438049-21b6-495f-8895-a5645d051354 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.186826 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5b438049-21b6-495f-8895-a5645d051354 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.187749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5b438049-21b6-495f-8895-a5645d051354 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.188377 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5b438049-21b6-495f-8895-a5645d051354 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.335321 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5b438049-21b6-495f-8895-a5645d051354 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:41.342914 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5b438049-21b6-495f-8895-a5645d051354 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.168631 May 24 15:40:41.343479 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 160/355] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:41 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:41.432343 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-80c247ad-2686-4e18-9c2b-40f18d45a840 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:41.433078 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-80c247ad-2686-4e18-9c2b-40f18d45a840 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:41.440957 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80c247ad-2686-4e18-9c2b-40f18d45a840 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.441940 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80c247ad-2686-4e18-9c2b-40f18d45a840 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.443197 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80c247ad-2686-4e18-9c2b-40f18d45a840 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.443857 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80c247ad-2686-4e18-9c2b-40f18d45a840 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.586894 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-80c247ad-2686-4e18-9c2b-40f18d45a840 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:41.595473 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-80c247ad-2686-4e18-9c2b-40f18d45a840 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:41.598295 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-80c247ad-2686-4e18-9c2b-40f18d45a840 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:41.599821 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-80c247ad-2686-4e18-9c2b-40f18d45a840 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.171612 May 24 15:40:41.600398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 196/356] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:41 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:41.934004 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bf4bd4a9-0c73-4e8a-b458-c6c405c30ea2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:41.934760 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bf4bd4a9-0c73-4e8a-b458-c6c405c30ea2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:41.941315 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf4bd4a9-0c73-4e8a-b458-c6c405c30ea2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.941784 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf4bd4a9-0c73-4e8a-b458-c6c405c30ea2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:41.942652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf4bd4a9-0c73-4e8a-b458-c6c405c30ea2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:41.943187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf4bd4a9-0c73-4e8a-b458-c6c405c30ea2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.010258 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bf4bd4a9-0c73-4e8a-b458-c6c405c30ea2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:42.018691 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bf4bd4a9-0c73-4e8a-b458-c6c405c30ea2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1270 microversion: 2.1 time: 0.088547 May 24 15:40:42.028542 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 161/357] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:41 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:42.365399 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-80a9dbbb-0ddb-47a7-ac0b-8f286ce6bc33 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:42.366448 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-80a9dbbb-0ddb-47a7-ac0b-8f286ce6bc33 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:42.413517 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80a9dbbb-0ddb-47a7-ac0b-8f286ce6bc33 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.416988 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80a9dbbb-0ddb-47a7-ac0b-8f286ce6bc33 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.417841 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80a9dbbb-0ddb-47a7-ac0b-8f286ce6bc33 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.418275 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80a9dbbb-0ddb-47a7-ac0b-8f286ce6bc33 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.571475 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-80a9dbbb-0ddb-47a7-ac0b-8f286ce6bc33 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:42.579210 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-80a9dbbb-0ddb-47a7-ac0b-8f286ce6bc33 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.217937 May 24 15:40:42.580305 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 197/358] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:42 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:42.621165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-fea21d8d-ee2e-4c32-9b2c-0101ff3f9deb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:42.622615 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-fea21d8d-ee2e-4c32-9b2c-0101ff3f9deb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:42.629077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fea21d8d-ee2e-4c32-9b2c-0101ff3f9deb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.629525 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fea21d8d-ee2e-4c32-9b2c-0101ff3f9deb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.630274 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fea21d8d-ee2e-4c32-9b2c-0101ff3f9deb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:42.630694 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fea21d8d-ee2e-4c32-9b2c-0101ff3f9deb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:42.765261 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-fea21d8d-ee2e-4c32-9b2c-0101ff3f9deb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:42.774254 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-fea21d8d-ee2e-4c32-9b2c-0101ff3f9deb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:42.775950 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-fea21d8d-ee2e-4c32-9b2c-0101ff3f9deb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:42.777154 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-fea21d8d-ee2e-4c32-9b2c-0101ff3f9deb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.162825 May 24 15:40:42.778011 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 162/359] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:42 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:43.037508 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ca182744-e504-4868-90bf-9b350878f5e0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:43.038417 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ca182744-e504-4868-90bf-9b350878f5e0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:43.045050 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca182744-e504-4868-90bf-9b350878f5e0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.045501 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca182744-e504-4868-90bf-9b350878f5e0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.046268 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca182744-e504-4868-90bf-9b350878f5e0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.046694 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca182744-e504-4868-90bf-9b350878f5e0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.112704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ca182744-e504-4868-90bf-9b350878f5e0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:43.121549 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ca182744-e504-4868-90bf-9b350878f5e0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1270 microversion: 2.1 time: 0.089815 May 24 15:40:43.122720 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 198/360] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:43 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:43.597281 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-8abe6565-0c1e-469a-b507-f78fe26af4b0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:43.603859 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8abe6565-0c1e-469a-b507-f78fe26af4b0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:43.610562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8abe6565-0c1e-469a-b507-f78fe26af4b0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.611198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8abe6565-0c1e-469a-b507-f78fe26af4b0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.612417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8abe6565-0c1e-469a-b507-f78fe26af4b0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.613181 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8abe6565-0c1e-469a-b507-f78fe26af4b0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.800278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-067c7387-1218-49fe-a24f-b702cdb9d06e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:43.803431 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-067c7387-1218-49fe-a24f-b702cdb9d06e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:43.827528 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8abe6565-0c1e-469a-b507-f78fe26af4b0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:43.835537 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-8abe6565-0c1e-469a-b507-f78fe26af4b0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.242787 May 24 15:40:43.843276 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-067c7387-1218-49fe-a24f-b702cdb9d06e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.844216 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-067c7387-1218-49fe-a24f-b702cdb9d06e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.846853 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-067c7387-1218-49fe-a24f-b702cdb9d06e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:43.848390 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-067c7387-1218-49fe-a24f-b702cdb9d06e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:43.850066 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 163/361] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:43 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:44.056660 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-067c7387-1218-49fe-a24f-b702cdb9d06e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:44.065504 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-067c7387-1218-49fe-a24f-b702cdb9d06e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:44.067434 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-067c7387-1218-49fe-a24f-b702cdb9d06e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:44.068852 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-067c7387-1218-49fe-a24f-b702cdb9d06e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.277776 May 24 15:40:44.069919 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 199/362] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:43 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:44.139213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2b185d51-0712-4f58-a2b7-22de61beb6c9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:44.139942 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2b185d51-0712-4f58-a2b7-22de61beb6c9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:44.147357 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2b185d51-0712-4f58-a2b7-22de61beb6c9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.147806 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2b185d51-0712-4f58-a2b7-22de61beb6c9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.148920 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2b185d51-0712-4f58-a2b7-22de61beb6c9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.149351 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2b185d51-0712-4f58-a2b7-22de61beb6c9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.256107 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2b185d51-0712-4f58-a2b7-22de61beb6c9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:44.264196 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2b185d51-0712-4f58-a2b7-22de61beb6c9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1276 microversion: 2.1 time: 0.129145 May 24 15:40:44.275590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 164/363] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:44 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:44.853758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1e9bb316-063a-421b-853e-e779bcb55a16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:44.854450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1e9bb316-063a-421b-853e-e779bcb55a16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:44.861737 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1e9bb316-063a-421b-853e-e779bcb55a16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.862432 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1e9bb316-063a-421b-853e-e779bcb55a16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.863446 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1e9bb316-063a-421b-853e-e779bcb55a16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:44.864306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1e9bb316-063a-421b-853e-e779bcb55a16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:44.882645 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=100 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:45.043564 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1e9bb316-063a-421b-853e-e779bcb55a16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:45.052626 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1e9bb316-063a-421b-853e-e779bcb55a16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.203769 May 24 15:40:45.063368 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 200/364] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:44 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:45.087083 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b4052728-3ef5-4506-97e7-e0472467bd67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:45.087687 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b4052728-3ef5-4506-97e7-e0472467bd67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:45.099426 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b4052728-3ef5-4506-97e7-e0472467bd67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.099871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b4052728-3ef5-4506-97e7-e0472467bd67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.100679 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b4052728-3ef5-4506-97e7-e0472467bd67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.101116 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b4052728-3ef5-4506-97e7-e0472467bd67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.284299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2f9fd39a-1ab5-4368-bd16-74c4c9300a8e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:45.285313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2f9fd39a-1ab5-4368-bd16-74c4c9300a8e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:45.299083 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f9fd39a-1ab5-4368-bd16-74c4c9300a8e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.301387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f9fd39a-1ab5-4368-bd16-74c4c9300a8e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.303876 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f9fd39a-1ab5-4368-bd16-74c4c9300a8e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.305377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f9fd39a-1ab5-4368-bd16-74c4c9300a8e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.315771 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b4052728-3ef5-4506-97e7-e0472467bd67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:45.333836 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b4052728-3ef5-4506-97e7-e0472467bd67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:45.337832 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b4052728-3ef5-4506-97e7-e0472467bd67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:45.340700 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b4052728-3ef5-4506-97e7-e0472467bd67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.256569 May 24 15:40:45.353845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 165/365] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:45 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:45.462952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-95d9899e-5f9c-4e6e-aa80-a8dc8ee47987 req-ecd7b795-a974-4e4f-886a-81aced0d26fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17e4548-782e-4115-aa63-48041fca571b", "tag": "33ccd1c3-9feb-4904-8e8e-8c99baa73704"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:45.488148 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-95d9899e-5f9c-4e6e-aa80-a8dc8ee47987 req-ecd7b795-a974-4e4f-886a-81aced0d26fe service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:45.488842 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-95d9899e-5f9c-4e6e-aa80-a8dc8ee47987 req-ecd7b795-a974-4e4f-886a-81aced0d26fe service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:45.500836 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-95d9899e-5f9c-4e6e-aa80-a8dc8ee47987 req-ecd7b795-a974-4e4f-886a-81aced0d26fe service nova] Creating event network-changed:33ccd1c3-9feb-4904-8e8e-8c99baa73704 for instance e17e4548-782e-4115-aa63-48041fca571b on hv-cinder-84315 May 24 15:40:45.521650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-95d9899e-5f9c-4e6e-aa80-a8dc8ee47987 req-ecd7b795-a974-4e4f-886a-81aced0d26fe service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064264 May 24 15:40:45.523376 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 166/366] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:40:45.552079 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2f9fd39a-1ab5-4368-bd16-74c4c9300a8e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:45.560637 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2f9fd39a-1ab5-4368-bd16-74c4c9300a8e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.281405 May 24 15:40:45.568264 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 201/367] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:45 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:46.073739 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-51ff6231-1a68-4064-ae18-df5fc547e8c9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:46.074451 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-51ff6231-1a68-4064-ae18-df5fc547e8c9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:46.081366 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-51ff6231-1a68-4064-ae18-df5fc547e8c9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.081890 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-51ff6231-1a68-4064-ae18-df5fc547e8c9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.083014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-51ff6231-1a68-4064-ae18-df5fc547e8c9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.083517 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-51ff6231-1a68-4064-ae18-df5fc547e8c9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.230461 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-51ff6231-1a68-4064-ae18-df5fc547e8c9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:46.240771 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-51ff6231-1a68-4064-ae18-df5fc547e8c9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.173610 May 24 15:40:46.241744 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 167/368] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:46 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:46.359923 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1990a4a1-e5a6-473f-969a-7c8275afb44d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:46.360512 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1990a4a1-e5a6-473f-969a-7c8275afb44d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:46.367176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1990a4a1-e5a6-473f-969a-7c8275afb44d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.367610 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1990a4a1-e5a6-473f-969a-7c8275afb44d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.368387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1990a4a1-e5a6-473f-969a-7c8275afb44d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.368811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1990a4a1-e5a6-473f-969a-7c8275afb44d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.430640 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:46.515567 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1990a4a1-e5a6-473f-969a-7c8275afb44d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:46.524488 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1990a4a1-e5a6-473f-969a-7c8275afb44d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:46.525968 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1990a4a1-e5a6-473f-969a-7c8275afb44d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:46.527120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1990a4a1-e5a6-473f-969a-7c8275afb44d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.171436 May 24 15:40:46.527861 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 202/369] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:46 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:46.577135 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ace48865-3651-4906-8851-ebaac055af5f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:46.577741 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ace48865-3651-4906-8851-ebaac055af5f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:46.579672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:46.580611 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=6 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:46.586117 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ace48865-3651-4906-8851-ebaac055af5f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.586788 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ace48865-3651-4906-8851-ebaac055af5f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.587827 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ace48865-3651-4906-8851-ebaac055af5f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:46.588443 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ace48865-3651-4906-8851-ebaac055af5f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:46.763450 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ace48865-3651-4906-8851-ebaac055af5f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:46.772853 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ace48865-3651-4906-8851-ebaac055af5f tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.199437 May 24 15:40:46.773745 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 168/370] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:46 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:47.258511 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4aee963e-ebc3-4532-bfe3-30a56adfcb0c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:47.259092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-4aee963e-ebc3-4532-bfe3-30a56adfcb0c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:47.267357 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4aee963e-ebc3-4532-bfe3-30a56adfcb0c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.267802 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4aee963e-ebc3-4532-bfe3-30a56adfcb0c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.268696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4aee963e-ebc3-4532-bfe3-30a56adfcb0c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.269328 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4aee963e-ebc3-4532-bfe3-30a56adfcb0c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.419599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-4aee963e-ebc3-4532-bfe3-30a56adfcb0c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.427269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-4aee963e-ebc3-4532-bfe3-30a56adfcb0c tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.172594 May 24 15:40:47.437260 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 203/371] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:47 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:47.547985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-09d40a75-3634-4a55-b0cf-3f310357a804 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:47.548533 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-09d40a75-3634-4a55-b0cf-3f310357a804 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:47.557421 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09d40a75-3634-4a55-b0cf-3f310357a804 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.558087 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09d40a75-3634-4a55-b0cf-3f310357a804 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.559025 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09d40a75-3634-4a55-b0cf-3f310357a804 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.559601 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09d40a75-3634-4a55-b0cf-3f310357a804 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.718128 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-09d40a75-3634-4a55-b0cf-3f310357a804 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.726779 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-09d40a75-3634-4a55-b0cf-3f310357a804 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.729412 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-09d40a75-3634-4a55-b0cf-3f310357a804 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.730768 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-09d40a75-3634-4a55-b0cf-3f310357a804 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.187652 May 24 15:40:47.744272 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 169/372] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:47 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:47.789542 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-63382013-db73-4163-af7a-098f04df8baa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:47.790156 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-63382013-db73-4163-af7a-098f04df8baa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:47.796303 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-63382013-db73-4163-af7a-098f04df8baa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.796990 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-63382013-db73-4163-af7a-098f04df8baa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.798629 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-63382013-db73-4163-af7a-098f04df8baa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.798995 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-63382013-db73-4163-af7a-098f04df8baa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.946868 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-63382013-db73-4163-af7a-098f04df8baa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:47.959706 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-63382013-db73-4163-af7a-098f04df8baa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.173913 May 24 15:40:47.964130 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-85349ee3-a222-4043-b2e9-69fc35ab2a37 req-847f8eee-cafc-4a2a-a372-412850d618ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f726278-c770-47b5-86db-c95db49ba80f", "name": "network-vif-plugged", "status": "completed", "tag": "123b7faa-d212-4186-93a9-6e1d900b7f9c"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:47.967909 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 204/373] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:47 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:47.983355 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-85349ee3-a222-4043-b2e9-69fc35ab2a37 req-847f8eee-cafc-4a2a-a372-412850d618ea service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:47.984051 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-85349ee3-a222-4043-b2e9-69fc35ab2a37 req-847f8eee-cafc-4a2a-a372-412850d618ea service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:47.996018 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-85349ee3-a222-4043-b2e9-69fc35ab2a37 req-847f8eee-cafc-4a2a-a372-412850d618ea service nova] Creating event network-vif-plugged:123b7faa-d212-4186-93a9-6e1d900b7f9c for instance 3f726278-c770-47b5-86db-c95db49ba80f on hv-cinder-84315 May 24 15:40:48.002058 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-85349ee3-a222-4043-b2e9-69fc35ab2a37 req-847f8eee-cafc-4a2a-a372-412850d618ea service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043077 May 24 15:40:48.002825 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 170/374] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:40:48.445735 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-43bd7de7-8e5c-4c0d-9284-690b9f9fac77 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:48.447058 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-43bd7de7-8e5c-4c0d-9284-690b9f9fac77 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:48.454317 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-43bd7de7-8e5c-4c0d-9284-690b9f9fac77 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:48.457242 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-43bd7de7-8e5c-4c0d-9284-690b9f9fac77 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:48.460207 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-43bd7de7-8e5c-4c0d-9284-690b9f9fac77 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:48.461541 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-43bd7de7-8e5c-4c0d-9284-690b9f9fac77 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:48.667326 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-43bd7de7-8e5c-4c0d-9284-690b9f9fac77 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:48.685337 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-43bd7de7-8e5c-4c0d-9284-690b9f9fac77 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.244313 May 24 15:40:48.695333 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 205/375] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:48 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:48.757131 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ebdcad36-0860-4cd1-9c2a-565c2382b155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:48.757824 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ebdcad36-0860-4cd1-9c2a-565c2382b155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:48.778945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ebdcad36-0860-4cd1-9c2a-565c2382b155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:48.779756 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ebdcad36-0860-4cd1-9c2a-565c2382b155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:48.781882 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ebdcad36-0860-4cd1-9c2a-565c2382b155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:48.783683 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ebdcad36-0860-4cd1-9c2a-565c2382b155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:48.990256 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-99ed4f59-739b-4c05-92b8-e0a2b95ad075 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:48.990959 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-99ed4f59-739b-4c05-92b8-e0a2b95ad075 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:49.009785 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-99ed4f59-739b-4c05-92b8-e0a2b95ad075 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.010238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-99ed4f59-739b-4c05-92b8-e0a2b95ad075 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.013291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-99ed4f59-739b-4c05-92b8-e0a2b95ad075 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.014987 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-99ed4f59-739b-4c05-92b8-e0a2b95ad075 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.139166 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ebdcad36-0860-4cd1-9c2a-565c2382b155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.147637 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=100 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:49.155758 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ebdcad36-0860-4cd1-9c2a-565c2382b155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.157548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ebdcad36-0860-4cd1-9c2a-565c2382b155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.169001 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ebdcad36-0860-4cd1-9c2a-565c2382b155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.410976 May 24 15:40:49.176713 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 171/376] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:48 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:49.270266 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-99ed4f59-739b-4c05-92b8-e0a2b95ad075 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.284246 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-99ed4f59-739b-4c05-92b8-e0a2b95ad075 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.303972 May 24 15:40:49.286755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 206/377] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:48 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:49.702716 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5410e974-04c5-47c8-82c3-118b285fc33e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:49.703330 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5410e974-04c5-47c8-82c3-118b285fc33e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:49.710833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5410e974-04c5-47c8-82c3-118b285fc33e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.711284 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5410e974-04c5-47c8-82c3-118b285fc33e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.712272 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5410e974-04c5-47c8-82c3-118b285fc33e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:49.712548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5410e974-04c5-47c8-82c3-118b285fc33e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:49.898634 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5410e974-04c5-47c8-82c3-118b285fc33e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:49.907288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5410e974-04c5-47c8-82c3-118b285fc33e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1370 microversion: 2.1 time: 0.208509 May 24 15:40:49.907841 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 172/378] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:49 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:50.186415 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-dbc11310-ebf1-4510-8418-d0d1fce710a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:50.188021 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-dbc11310-ebf1-4510-8418-d0d1fce710a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:50.195513 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dbc11310-ebf1-4510-8418-d0d1fce710a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.196449 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dbc11310-ebf1-4510-8418-d0d1fce710a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.197716 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dbc11310-ebf1-4510-8418-d0d1fce710a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.198578 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dbc11310-ebf1-4510-8418-d0d1fce710a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.303389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2eafca09-41a7-406c-8a11-0eec6b130643 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:50.303999 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2eafca09-41a7-406c-8a11-0eec6b130643 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:50.313071 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2eafca09-41a7-406c-8a11-0eec6b130643 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.316215 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2eafca09-41a7-406c-8a11-0eec6b130643 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.317310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2eafca09-41a7-406c-8a11-0eec6b130643 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.320687 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2eafca09-41a7-406c-8a11-0eec6b130643 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.426788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dbc11310-ebf1-4510-8418-d0d1fce710a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:50.442988 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dbc11310-ebf1-4510-8418-d0d1fce710a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:50.444513 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dbc11310-ebf1-4510-8418-d0d1fce710a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:50.445730 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-dbc11310-ebf1-4510-8418-d0d1fce710a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.265547 May 24 15:40:50.446914 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 207/379] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:50 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:50.562949 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2eafca09-41a7-406c-8a11-0eec6b130643 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:50.573335 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2eafca09-41a7-406c-8a11-0eec6b130643 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.275153 May 24 15:40:50.574668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 173/380] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:50 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:50.924488 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b11a09d3-bd0d-46d7-80dc-fd5941e902c3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:50.925188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b11a09d3-bd0d-46d7-80dc-fd5941e902c3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:50.931481 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b11a09d3-bd0d-46d7-80dc-fd5941e902c3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.931981 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b11a09d3-bd0d-46d7-80dc-fd5941e902c3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:50.932825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b11a09d3-bd0d-46d7-80dc-fd5941e902c3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:50.933344 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b11a09d3-bd0d-46d7-80dc-fd5941e902c3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.072301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b11a09d3-bd0d-46d7-80dc-fd5941e902c3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.080102 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b11a09d3-bd0d-46d7-80dc-fd5941e902c3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1563 microversion: 2.1 time: 0.159403 May 24 15:40:51.080837 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 208/381] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:50 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:51.096440 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3572caf7-cc43-4a2d-8cef-e60e30078eb7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:51.097530 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3572caf7-cc43-4a2d-8cef-e60e30078eb7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:51.104110 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3572caf7-cc43-4a2d-8cef-e60e30078eb7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.104767 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3572caf7-cc43-4a2d-8cef-e60e30078eb7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.105724 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3572caf7-cc43-4a2d-8cef-e60e30078eb7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.106307 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3572caf7-cc43-4a2d-8cef-e60e30078eb7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.184453 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3572caf7-cc43-4a2d-8cef-e60e30078eb7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091743 May 24 15:40:51.185048 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 174/382] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 24 15:40:51 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:40:51.466050 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0ca22282-6ba9-4c9e-ae91-5ae703fe3793 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:51.466645 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0ca22282-6ba9-4c9e-ae91-5ae703fe3793 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:51.474014 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0ca22282-6ba9-4c9e-ae91-5ae703fe3793 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.474457 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0ca22282-6ba9-4c9e-ae91-5ae703fe3793 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.475231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0ca22282-6ba9-4c9e-ae91-5ae703fe3793 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.475664 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0ca22282-6ba9-4c9e-ae91-5ae703fe3793 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.598824 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2df76250-1a49-4c76-865c-c052e80b9335 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:51.600729 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2df76250-1a49-4c76-865c-c052e80b9335 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:51.616644 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2df76250-1a49-4c76-865c-c052e80b9335 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.617281 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2df76250-1a49-4c76-865c-c052e80b9335 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.618244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2df76250-1a49-4c76-865c-c052e80b9335 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:51.618861 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2df76250-1a49-4c76-865c-c052e80b9335 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:51.813126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0ca22282-6ba9-4c9e-ae91-5ae703fe3793 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.823730 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0ca22282-6ba9-4c9e-ae91-5ae703fe3793 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.825124 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0ca22282-6ba9-4c9e-ae91-5ae703fe3793 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.826283 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0ca22282-6ba9-4c9e-ae91-5ae703fe3793 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1737 microversion: 2.20 time: 0.365005 May 24 15:40:51.826836 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 209/383] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:51 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1737 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:51.951324 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2df76250-1a49-4c76-865c-c052e80b9335 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:51.963484 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2df76250-1a49-4c76-865c-c052e80b9335 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.375885 May 24 15:40:51.964392 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 175/384] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:51 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:52.824091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-99610e0d-10c0-4fc1-ac92-3398c716e618 req-ba23a07b-9242-4846-94c7-f68f3219ef77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f726278-c770-47b5-86db-c95db49ba80f", "tag": "123b7faa-d212-4186-93a9-6e1d900b7f9c"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:52.833977 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-99610e0d-10c0-4fc1-ac92-3398c716e618 req-ba23a07b-9242-4846-94c7-f68f3219ef77 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.834503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-99610e0d-10c0-4fc1-ac92-3398c716e618 req-ba23a07b-9242-4846-94c7-f68f3219ef77 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:52.844312 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1fd25a20-d965-49ea-a232-fe5d641abbc9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:52.844918 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1fd25a20-d965-49ea-a232-fe5d641abbc9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:52.858607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1fd25a20-d965-49ea-a232-fe5d641abbc9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.859092 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1fd25a20-d965-49ea-a232-fe5d641abbc9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:52.859886 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1fd25a20-d965-49ea-a232-fe5d641abbc9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:52.860346 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1fd25a20-d965-49ea-a232-fe5d641abbc9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:52.867241 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-99610e0d-10c0-4fc1-ac92-3398c716e618 req-ba23a07b-9242-4846-94c7-f68f3219ef77 service nova] Creating event network-changed:123b7faa-d212-4186-93a9-6e1d900b7f9c for instance 3f726278-c770-47b5-86db-c95db49ba80f on hv-cinder-84315 May 24 15:40:52.874783 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-99610e0d-10c0-4fc1-ac92-3398c716e618 req-ba23a07b-9242-4846-94c7-f68f3219ef77 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054296 May 24 15:40:52.877489 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 210/385] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:40:52.985089 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0a156799-5b2e-4b6e-b198-17484779aff4 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:52.986168 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0a156799-5b2e-4b6e-b198-17484779aff4 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:53.009683 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0a156799-5b2e-4b6e-b198-17484779aff4 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:53.010258 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0a156799-5b2e-4b6e-b198-17484779aff4 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:53.020795 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0a156799-5b2e-4b6e-b198-17484779aff4 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:53.021467 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0a156799-5b2e-4b6e-b198-17484779aff4 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:53.051263 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1fd25a20-d965-49ea-a232-fe5d641abbc9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:53.065574 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1fd25a20-d965-49ea-a232-fe5d641abbc9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:53.067200 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1fd25a20-d965-49ea-a232-fe5d641abbc9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:53.068443 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1fd25a20-d965-49ea-a232-fe5d641abbc9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1719 microversion: 2.20 time: 0.228093 May 24 15:40:53.069379 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 176/386] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:52 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:40:53.269927 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0a156799-5b2e-4b6e-b198-17484779aff4 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:53.278064 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0a156799-5b2e-4b6e-b198-17484779aff4 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.298532 May 24 15:40:53.278821 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 211/387] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:52 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:54.093497 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-8b1eb65d-e1e3-462d-871c-24bfb2ba817a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:54.094128 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8b1eb65d-e1e3-462d-871c-24bfb2ba817a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:54.103890 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8b1eb65d-e1e3-462d-871c-24bfb2ba817a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:54.104943 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8b1eb65d-e1e3-462d-871c-24bfb2ba817a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:54.105993 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8b1eb65d-e1e3-462d-871c-24bfb2ba817a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:54.106717 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8b1eb65d-e1e3-462d-871c-24bfb2ba817a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:54.297042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d4ab4853-1163-4a2a-b8ab-e3aa63b678f0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:54.298592 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d4ab4853-1163-4a2a-b8ab-e3aa63b678f0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:54.307589 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d4ab4853-1163-4a2a-b8ab-e3aa63b678f0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:54.308369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d4ab4853-1163-4a2a-b8ab-e3aa63b678f0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:54.309510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d4ab4853-1163-4a2a-b8ab-e3aa63b678f0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:54.310082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d4ab4853-1163-4a2a-b8ab-e3aa63b678f0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:54.394266 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8b1eb65d-e1e3-462d-871c-24bfb2ba817a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:54.403659 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8b1eb65d-e1e3-462d-871c-24bfb2ba817a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:54.405604 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8b1eb65d-e1e3-462d-871c-24bfb2ba817a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:54.407017 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-8b1eb65d-e1e3-462d-871c-24bfb2ba817a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1719 microversion: 2.20 time: 0.324106 May 24 15:40:54.408133 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 177/388] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:54 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1719 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:54.868063 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d4ab4853-1163-4a2a-b8ab-e3aa63b678f0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:54.877095 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d4ab4853-1163-4a2a-b8ab-e3aa63b678f0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.585510 May 24 15:40:54.877869 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 212/389] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:54 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:55.425484 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-12237d92-0e95-4659-a70e-96e08bc063f8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:55.426092 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-12237d92-0e95-4659-a70e-96e08bc063f8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:55.435262 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12237d92-0e95-4659-a70e-96e08bc063f8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.435962 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12237d92-0e95-4659-a70e-96e08bc063f8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.436908 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12237d92-0e95-4659-a70e-96e08bc063f8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.437586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12237d92-0e95-4659-a70e-96e08bc063f8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.650341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-12237d92-0e95-4659-a70e-96e08bc063f8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:55.671006 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-12237d92-0e95-4659-a70e-96e08bc063f8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:55.672519 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-12237d92-0e95-4659-a70e-96e08bc063f8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:55.673679 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-12237d92-0e95-4659-a70e-96e08bc063f8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1719 microversion: 2.20 time: 0.252110 May 24 15:40:55.674231 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 178/390] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:55 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1719 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:55.899137 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e0133536-577d-42b9-aa71-158006f01496 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:55.899832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e0133536-577d-42b9-aa71-158006f01496 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:55.906592 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e0133536-577d-42b9-aa71-158006f01496 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.907122 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e0133536-577d-42b9-aa71-158006f01496 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:55.907977 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e0133536-577d-42b9-aa71-158006f01496 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:55.908531 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e0133536-577d-42b9-aa71-158006f01496 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:56.120793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e0133536-577d-42b9-aa71-158006f01496 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:56.129180 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e0133536-577d-42b9-aa71-158006f01496 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.235065 May 24 15:40:56.139042 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 213/391] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:55 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:56.696709 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a260d81e-ccdd-48a5-a1f7-6aa45f830e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:56.697910 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a260d81e-ccdd-48a5-a1f7-6aa45f830e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:56.712843 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a260d81e-ccdd-48a5-a1f7-6aa45f830e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:56.713620 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a260d81e-ccdd-48a5-a1f7-6aa45f830e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:56.714926 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a260d81e-ccdd-48a5-a1f7-6aa45f830e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:56.716574 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a260d81e-ccdd-48a5-a1f7-6aa45f830e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:56.927294 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a260d81e-ccdd-48a5-a1f7-6aa45f830e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:56.940571 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a260d81e-ccdd-48a5-a1f7-6aa45f830e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:56.942653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a260d81e-ccdd-48a5-a1f7-6aa45f830e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:56.944557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a260d81e-ccdd-48a5-a1f7-6aa45f830e06 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1719 microversion: 2.20 time: 0.252362 May 24 15:40:56.946130 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 179/392] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:56 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1719 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:57.145418 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8942403e-f8b4-4184-9844-e1cca465a5bb tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:57.150752 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-9bbe9488-c587-4d70-b5ef-f551bbca8537 req-678f6e6a-127d-465c-93da-488d8d759d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17e4548-782e-4115-aa63-48041fca571b", "name": "network-vif-plugged", "status": "completed", "tag": "33ccd1c3-9feb-4904-8e8e-8c99baa73704"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:57.152797 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8942403e-f8b4-4184-9844-e1cca465a5bb tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:57.165633 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8942403e-f8b4-4184-9844-e1cca465a5bb tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.169135 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8942403e-f8b4-4184-9844-e1cca465a5bb tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.170927 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8942403e-f8b4-4184-9844-e1cca465a5bb tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.171380 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-9bbe9488-c587-4d70-b5ef-f551bbca8537 req-678f6e6a-127d-465c-93da-488d8d759d10 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.172180 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-9bbe9488-c587-4d70-b5ef-f551bbca8537 req-678f6e6a-127d-465c-93da-488d8d759d10 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.172822 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8942403e-f8b4-4184-9844-e1cca465a5bb tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.197540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-9bbe9488-c587-4d70-b5ef-f551bbca8537 req-678f6e6a-127d-465c-93da-488d8d759d10 service nova] Creating event network-vif-plugged:33ccd1c3-9feb-4904-8e8e-8c99baa73704 for instance e17e4548-782e-4115-aa63-48041fca571b on hv-cinder-84315 May 24 15:40:57.212117 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-9bbe9488-c587-4d70-b5ef-f551bbca8537 req-678f6e6a-127d-465c-93da-488d8d759d10 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065045 May 24 15:40:57.213506 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 180/393] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:40:57.638943 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8942403e-f8b4-4184-9844-e1cca465a5bb tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:57.676883 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8942403e-f8b4-4184-9844-e1cca465a5bb tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.535289 May 24 15:40:57.683761 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 214/394] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:57 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:40:57.964691 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5055fbdf-3d61-41d7-96c2-d8bd07e08157 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:57.966134 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5055fbdf-3d61-41d7-96c2-d8bd07e08157 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:57.982710 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5055fbdf-3d61-41d7-96c2-d8bd07e08157 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.983172 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5055fbdf-3d61-41d7-96c2-d8bd07e08157 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:57.983960 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5055fbdf-3d61-41d7-96c2-d8bd07e08157 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:57.984590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5055fbdf-3d61-41d7-96c2-d8bd07e08157 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.199360 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5055fbdf-3d61-41d7-96c2-d8bd07e08157 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:58.210744 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5055fbdf-3d61-41d7-96c2-d8bd07e08157 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:58.212987 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5055fbdf-3d61-41d7-96c2-d8bd07e08157 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:58.214625 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5055fbdf-3d61-41d7-96c2-d8bd07e08157 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1722 microversion: 2.20 time: 0.255414 May 24 15:40:58.215766 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 181/395] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:57 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:58.235082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-70ed57d3-417c-452c-86b0-1066446df8cb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65b9ac42-09a2-4494-ad86-964e07db25dc"}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:58.236659 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-70ed57d3-417c-452c-86b0-1066446df8cb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:58.243454 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-70ed57d3-417c-452c-86b0-1066446df8cb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.243985 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-70ed57d3-417c-452c-86b0-1066446df8cb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.244845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-70ed57d3-417c-452c-86b0-1066446df8cb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.245306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-70ed57d3-417c-452c-86b0-1066446df8cb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.491970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:40:58.590929 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-70ed57d3-417c-452c-86b0-1066446df8cb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "POST /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.360771 May 24 15:40:58.597016 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 215/396] 10.222.0.55 () {62 vars in 1363 bytes} [Tue May 24 15:40:58 2022] POST /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments => generated 188 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:40:58.700961 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7608d3f7-453d-4248-bf6a-8e9a30039c91 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:58.703065 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7608d3f7-453d-4248-bf6a-8e9a30039c91 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:58.711275 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7608d3f7-453d-4248-bf6a-8e9a30039c91 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.713317 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7608d3f7-453d-4248-bf6a-8e9a30039c91 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.714376 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7608d3f7-453d-4248-bf6a-8e9a30039c91 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.715021 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7608d3f7-453d-4248-bf6a-8e9a30039c91 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.735329 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7e7d4680-ff08-49e3-8901-4b63f737120c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:58.736213 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7e7d4680-ff08-49e3-8901-4b63f737120c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:58.743350 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e7d4680-ff08-49e3-8901-4b63f737120c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.744203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e7d4680-ff08-49e3-8901-4b63f737120c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.745195 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e7d4680-ff08-49e3-8901-4b63f737120c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.745815 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e7d4680-ff08-49e3-8901-4b63f737120c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.850650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7e7d4680-ff08-49e3-8901-4b63f737120c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "POST /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/action" status: 202 len: 0 microversion: 2.20 time: 0.119252 May 24 15:40:58.852474 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 216/397] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 24 15:40:58 2022] POST /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 15:40:58.865789 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-758ecee6-7dac-4c10-bc8a-be4eb8774d84 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:58.866530 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-758ecee6-7dac-4c10-bc8a-be4eb8774d84 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:58.879375 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-758ecee6-7dac-4c10-bc8a-be4eb8774d84 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.879941 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-758ecee6-7dac-4c10-bc8a-be4eb8774d84 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.880955 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-758ecee6-7dac-4c10-bc8a-be4eb8774d84 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:58.881676 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-758ecee6-7dac-4c10-bc8a-be4eb8774d84 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:58.959125 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7608d3f7-453d-4248-bf6a-8e9a30039c91 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:58.977766 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7608d3f7-453d-4248-bf6a-8e9a30039c91 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1318 microversion: 2.1 time: 0.280867 May 24 15:40:58.988709 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 182/398] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:58 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:40:59.214574 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-758ecee6-7dac-4c10-bc8a-be4eb8774d84 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:59.226889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-758ecee6-7dac-4c10-bc8a-be4eb8774d84 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:59.228425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-758ecee6-7dac-4c10-bc8a-be4eb8774d84 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:40:59.233369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-758ecee6-7dac-4c10-bc8a-be4eb8774d84 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1748 microversion: 2.20 time: 0.368735 May 24 15:40:59.234014 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 217/399] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:40:58 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1748 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:40:59.263856 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-799ecae3-2ddc-40f4-acd1-1645bfe18046 req-74b861a5-1e48-4db3-ab26-51070ac97043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2694ac-4a5e-4cfa-aaf8-877c8285148a", "name": "network-vif-unplugged", "status": "completed", "tag": "b4136280-42c5-46f1-8248-0dcb997d0277"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:40:59.273494 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-799ecae3-2ddc-40f4-acd1-1645bfe18046 req-74b861a5-1e48-4db3-ab26-51070ac97043 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:40:59.273930 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-799ecae3-2ddc-40f4-acd1-1645bfe18046 req-74b861a5-1e48-4db3-ab26-51070ac97043 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:40:59.287413 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.compute.server_external_events [req-799ecae3-2ddc-40f4-acd1-1645bfe18046 req-74b861a5-1e48-4db3-ab26-51070ac97043 service nova] Unable to find a host for instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a. Dropping event network-vif-unplugged {{(pid=129339) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 24 15:40:59.288309 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-799ecae3-2ddc-40f4-acd1-1645bfe18046 req-74b861a5-1e48-4db3-ab26-51070ac97043 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028484 May 24 15:40:59.289069 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 183/400] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 24 15:40:59.995315 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-10b18348-5cd7-42e0-a337-e46a8532721b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:40:59.996079 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-10b18348-5cd7-42e0-a337-e46a8532721b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:40:59.998092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=84 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:00.014040 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-10b18348-5cd7-42e0-a337-e46a8532721b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:00.014914 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-10b18348-5cd7-42e0-a337-e46a8532721b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.015886 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-10b18348-5cd7-42e0-a337-e46a8532721b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:00.016449 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-10b18348-5cd7-42e0-a337-e46a8532721b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.255826 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f1d1e47b-4c0f-46cd-b3bc-fd1467d76632 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:00.256999 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f1d1e47b-4c0f-46cd-b3bc-fd1467d76632 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:00.273844 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f1d1e47b-4c0f-46cd-b3bc-fd1467d76632 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:00.275822 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f1d1e47b-4c0f-46cd-b3bc-fd1467d76632 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.277222 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f1d1e47b-4c0f-46cd-b3bc-fd1467d76632 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:00.282253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f1d1e47b-4c0f-46cd-b3bc-fd1467d76632 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:00.290202 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-10b18348-5cd7-42e0-a337-e46a8532721b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:00.300657 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-10b18348-5cd7-42e0-a337-e46a8532721b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1507 microversion: 2.1 time: 0.309051 May 24 15:41:00.301951 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 218/401] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:40:59 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1507 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:00.556770 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f1d1e47b-4c0f-46cd-b3bc-fd1467d76632 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:00.568785 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f1d1e47b-4c0f-46cd-b3bc-fd1467d76632 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:00.574477 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f1d1e47b-4c0f-46cd-b3bc-fd1467d76632 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:00.581148 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f1d1e47b-4c0f-46cd-b3bc-fd1467d76632 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1748 microversion: 2.20 time: 0.330901 May 24 15:41:00.583845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 184/402] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:00 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1748 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:01.602228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-01cfecc3-5424-4bd9-81de-23829a2d34f0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:01.602825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-01cfecc3-5424-4bd9-81de-23829a2d34f0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:01.610213 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01cfecc3-5424-4bd9-81de-23829a2d34f0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:01.610995 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01cfecc3-5424-4bd9-81de-23829a2d34f0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:01.612070 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01cfecc3-5424-4bd9-81de-23829a2d34f0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:01.612749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01cfecc3-5424-4bd9-81de-23829a2d34f0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:02.010009 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-01cfecc3-5424-4bd9-81de-23829a2d34f0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:02.024806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-01cfecc3-5424-4bd9-81de-23829a2d34f0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:02.026566 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-01cfecc3-5424-4bd9-81de-23829a2d34f0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:02.027725 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-01cfecc3-5424-4bd9-81de-23829a2d34f0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1750 microversion: 2.20 time: 0.429353 May 24 15:41:02.028320 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 219/403] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:01 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1750 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:03.058067 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-854d39c6-42e1-4168-8115-289896578e35 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:03.059277 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-854d39c6-42e1-4168-8115-289896578e35 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:03.068631 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-854d39c6-42e1-4168-8115-289896578e35 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:03.069259 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-854d39c6-42e1-4168-8115-289896578e35 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:03.072769 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-854d39c6-42e1-4168-8115-289896578e35 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:03.073429 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-854d39c6-42e1-4168-8115-289896578e35 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:03.577043 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-854d39c6-42e1-4168-8115-289896578e35 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:03.595377 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-854d39c6-42e1-4168-8115-289896578e35 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:03.601065 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-854d39c6-42e1-4168-8115-289896578e35 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:03.607832 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-854d39c6-42e1-4168-8115-289896578e35 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.560780 May 24 15:41:03.609146 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 185/404] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:03 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:04.632982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-bc7db9b7-b25d-4180-860b-2aca8917d021 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:04.634598 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-bc7db9b7-b25d-4180-860b-2aca8917d021 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:04.652413 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc7db9b7-b25d-4180-860b-2aca8917d021 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:04.653298 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc7db9b7-b25d-4180-860b-2aca8917d021 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:04.653604 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc7db9b7-b25d-4180-860b-2aca8917d021 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:04.654044 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc7db9b7-b25d-4180-860b-2aca8917d021 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:04.991539 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2050295278", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:05.163508 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-bc7db9b7-b25d-4180-860b-2aca8917d021 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:05.176284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-bc7db9b7-b25d-4180-860b-2aca8917d021 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:05.178475 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-bc7db9b7-b25d-4180-860b-2aca8917d021 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:05.180149 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-bc7db9b7-b25d-4180-860b-2aca8917d021 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.557019 May 24 15:41:05.193418 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 220/405] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:04 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:05.581665 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8f418ee1-65ca-4b9c-aa75-bfb713574455 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Action: 'create', calling method: .version_select at 0x7fb1d49b1a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-466910550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG9VXi2G1nC6qp5CXk070a864UDlhM8ZbWysLhRr0nRuxL65C1rzmFknK9ZyFOzz4DKGtPgLP4Lgx2rC8J4ealpGh10ERuuJhSohtiCz4r4vIoIbmlMhVKtDLLSlfXZAw=="}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:05.600509 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-8f418ee1-65ca-4b9c-aa75-bfb713574455 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Getting quotas for project dc2810000275432fb1337151b6883e90. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:41:05.605755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-8f418ee1-65ca-4b9c-aa75-bfb713574455 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Getting quotas for user 0a3a64d88e89402b907789c7f030e080 and project dc2810000275432fb1337151b6883e90. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:41:05.639115 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8f418ee1-65ca-4b9c-aa75-bfb713574455 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.319466 May 24 15:41:05.640974 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 221/406] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 24 15:41:05 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:41:06.200682 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f18725d7-5fd4-452f-ae9e-8af07c701b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:06.202250 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f18725d7-5fd4-452f-ae9e-8af07c701b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:06.209923 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f18725d7-5fd4-452f-ae9e-8af07c701b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:06.210693 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f18725d7-5fd4-452f-ae9e-8af07c701b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:06.211818 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f18725d7-5fd4-452f-ae9e-8af07c701b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:06.212479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f18725d7-5fd4-452f-ae9e-8af07c701b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:06.472160 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f18725d7-5fd4-452f-ae9e-8af07c701b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:06.488826 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f18725d7-5fd4-452f-ae9e-8af07c701b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:06.492213 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f18725d7-5fd4-452f-ae9e-8af07c701b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:06.494276 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f18725d7-5fd4-452f-ae9e-8af07c701b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.298053 May 24 15:41:06.495889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 222/407] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:06 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:07.517640 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3bda36f6-0951-495f-9460-638dd8f2c051 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:07.519670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3bda36f6-0951-495f-9460-638dd8f2c051 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:07.530244 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3bda36f6-0951-495f-9460-638dd8f2c051 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:07.530748 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3bda36f6-0951-495f-9460-638dd8f2c051 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:07.531623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3bda36f6-0951-495f-9460-638dd8f2c051 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:07.532021 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3bda36f6-0951-495f-9460-638dd8f2c051 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:07.766126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3bda36f6-0951-495f-9460-638dd8f2c051 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:07.775954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3bda36f6-0951-495f-9460-638dd8f2c051 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:07.777468 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3bda36f6-0951-495f-9460-638dd8f2c051 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:07.788678 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3bda36f6-0951-495f-9460-638dd8f2c051 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.278118 May 24 15:41:07.789661 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 223/408] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:07 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:08.809458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fac74d72-0fe8-4ea1-80a7-438e0a4a02cf tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:08.811442 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fac74d72-0fe8-4ea1-80a7-438e0a4a02cf tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:08.818590 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fac74d72-0fe8-4ea1-80a7-438e0a4a02cf tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:08.819110 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fac74d72-0fe8-4ea1-80a7-438e0a4a02cf tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:08.819974 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fac74d72-0fe8-4ea1-80a7-438e0a4a02cf tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:08.820489 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fac74d72-0fe8-4ea1-80a7-438e0a4a02cf tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:08.991073 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fac74d72-0fe8-4ea1-80a7-438e0a4a02cf tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:09.001382 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fac74d72-0fe8-4ea1-80a7-438e0a4a02cf tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:09.003014 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fac74d72-0fe8-4ea1-80a7-438e0a4a02cf tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:09.004394 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fac74d72-0fe8-4ea1-80a7-438e0a4a02cf tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.199835 May 24 15:41:09.004997 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 224/409] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:08 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:10.023261 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-81218d41-5dfd-4157-a172-d849927751e2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:10.023978 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-81218d41-5dfd-4157-a172-d849927751e2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:10.029942 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-81218d41-5dfd-4157-a172-d849927751e2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:10.030384 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-81218d41-5dfd-4157-a172-d849927751e2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:10.031211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-81218d41-5dfd-4157-a172-d849927751e2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:10.031618 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-81218d41-5dfd-4157-a172-d849927751e2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:10.181257 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-81218d41-5dfd-4157-a172-d849927751e2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:10.189778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-81218d41-5dfd-4157-a172-d849927751e2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:10.191383 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-81218d41-5dfd-4157-a172-d849927751e2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:10.192703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-81218d41-5dfd-4157-a172-d849927751e2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.173769 May 24 15:41:10.193276 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 225/410] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:10 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:11.211018 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8c8d482e-bf97-4bcd-9d82-c80a7016b5f9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:11.212887 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8c8d482e-bf97-4bcd-9d82-c80a7016b5f9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:11.222231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c8d482e-bf97-4bcd-9d82-c80a7016b5f9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:11.222843 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c8d482e-bf97-4bcd-9d82-c80a7016b5f9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:11.223653 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c8d482e-bf97-4bcd-9d82-c80a7016b5f9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:11.224111 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c8d482e-bf97-4bcd-9d82-c80a7016b5f9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:11.368745 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8c8d482e-bf97-4bcd-9d82-c80a7016b5f9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:11.377955 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8c8d482e-bf97-4bcd-9d82-c80a7016b5f9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:11.379811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8c8d482e-bf97-4bcd-9d82-c80a7016b5f9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:11.381230 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8c8d482e-bf97-4bcd-9d82-c80a7016b5f9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.174205 May 24 15:41:11.381955 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 226/411] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:11 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:12.399769 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-dffbcd9e-3c56-49cc-a5da-a59c86051877 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:12.400523 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-dffbcd9e-3c56-49cc-a5da-a59c86051877 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:12.407225 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dffbcd9e-3c56-49cc-a5da-a59c86051877 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:12.407806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dffbcd9e-3c56-49cc-a5da-a59c86051877 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:12.408610 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dffbcd9e-3c56-49cc-a5da-a59c86051877 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:12.409177 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dffbcd9e-3c56-49cc-a5da-a59c86051877 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:12.562722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dffbcd9e-3c56-49cc-a5da-a59c86051877 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:12.572584 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dffbcd9e-3c56-49cc-a5da-a59c86051877 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:12.574326 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dffbcd9e-3c56-49cc-a5da-a59c86051877 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:12.575678 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-dffbcd9e-3c56-49cc-a5da-a59c86051877 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.180165 May 24 15:41:12.580176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 227/412] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:12 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:12.921366 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] validate_networks() for None {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:41:13.327685 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:41:13.328371 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:41:13.330242 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:41:13.330242 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:41:13.330242 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:41:13.333141 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:13.342081 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.342692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.343490 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.343924 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.364309 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Getting quotas for project 25ca54924ba846d2ad7a1972f1cb351c. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:41:13.368946 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Getting quotas for user f7e65818d4f8416c9bc1b5491d76c8ec and project 25ca54924ba846d2ad7a1972f1cb351c. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:41:13.382190 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:41:13.385122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:41:13.444048 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-20a67cb4-532d-454a-9787-9000477e504e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.457036 May 24 15:41:13.445318 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 186/413] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 8459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 15:41:13.458183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6e06fd14-2b91-4718-8853-dda42004df20 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:13.459353 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6e06fd14-2b91-4718-8853-dda42004df20 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:13.574909 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6e06fd14-2b91-4718-8853-dda42004df20 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:13.584713 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6e06fd14-2b91-4718-8853-dda42004df20 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1215 microversion: 2.1 time: 0.133558 May 24 15:41:13.585976 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 228/414] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:13 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:13.599882 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-86ee9641-2368-494d-8ca3-8b3dc0339b4c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:13.600696 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-86ee9641-2368-494d-8ca3-8b3dc0339b4c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:13.614376 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-86ee9641-2368-494d-8ca3-8b3dc0339b4c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.615014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-86ee9641-2368-494d-8ca3-8b3dc0339b4c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.615937 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-86ee9641-2368-494d-8ca3-8b3dc0339b4c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:13.616533 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-86ee9641-2368-494d-8ca3-8b3dc0339b4c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:13.803376 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-86ee9641-2368-494d-8ca3-8b3dc0339b4c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:13.821181 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-86ee9641-2368-494d-8ca3-8b3dc0339b4c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:13.828357 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-86ee9641-2368-494d-8ca3-8b3dc0339b4c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:13.829732 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-86ee9641-2368-494d-8ca3-8b3dc0339b4c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.233749 May 24 15:41:13.830283 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 187/415] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:13 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:14.602952 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a018b09f-ae0b-4bae-b770-158e3b837e8d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:14.603548 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a018b09f-ae0b-4bae-b770-158e3b837e8d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:14.609723 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a018b09f-ae0b-4bae-b770-158e3b837e8d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:14.610154 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a018b09f-ae0b-4bae-b770-158e3b837e8d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.610908 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a018b09f-ae0b-4bae-b770-158e3b837e8d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:14.611326 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a018b09f-ae0b-4bae-b770-158e3b837e8d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.679435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a018b09f-ae0b-4bae-b770-158e3b837e8d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:14.687515 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a018b09f-ae0b-4bae-b770-158e3b837e8d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1219 microversion: 2.1 time: 0.088638 May 24 15:41:14.688367 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 229/416] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:14 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:14.849457 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-33cb34b0-e308-4506-b540-844386b0c5b6 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:14.850038 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-33cb34b0-e308-4506-b540-844386b0c5b6 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:14.857700 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-33cb34b0-e308-4506-b540-844386b0c5b6 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:14.858144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-33cb34b0-e308-4506-b540-844386b0c5b6 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.858897 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-33cb34b0-e308-4506-b540-844386b0c5b6 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:14.859323 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-33cb34b0-e308-4506-b540-844386b0c5b6 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:14.997505 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-33cb34b0-e308-4506-b540-844386b0c5b6 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:15.006180 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-33cb34b0-e308-4506-b540-844386b0c5b6 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:15.007709 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-33cb34b0-e308-4506-b540-844386b0c5b6 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:15.008901 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-33cb34b0-e308-4506-b540-844386b0c5b6 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.163530 May 24 15:41:15.009476 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 188/417] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:14 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:15.704881 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-68789141-19df-47a2-a0e0-d5b0e8109085 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:15.705445 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-68789141-19df-47a2-a0e0-d5b0e8109085 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:15.716892 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68789141-19df-47a2-a0e0-d5b0e8109085 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:15.717642 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68789141-19df-47a2-a0e0-d5b0e8109085 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:15.718897 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68789141-19df-47a2-a0e0-d5b0e8109085 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:15.719879 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68789141-19df-47a2-a0e0-d5b0e8109085 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:15.795006 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-68789141-19df-47a2-a0e0-d5b0e8109085 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:15.804063 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-68789141-19df-47a2-a0e0-d5b0e8109085 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1219 microversion: 2.1 time: 0.103047 May 24 15:41:15.804683 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 230/418] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:15 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:16.029227 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a8785f7d-5d3c-47e9-a712-2946c8c0d3a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:16.029851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a8785f7d-5d3c-47e9-a712-2946c8c0d3a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:16.036903 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8785f7d-5d3c-47e9-a712-2946c8c0d3a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:16.037325 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8785f7d-5d3c-47e9-a712-2946c8c0d3a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:16.038104 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8785f7d-5d3c-47e9-a712-2946c8c0d3a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:16.038529 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8785f7d-5d3c-47e9-a712-2946c8c0d3a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:16.171438 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a8785f7d-5d3c-47e9-a712-2946c8c0d3a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:16.180181 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a8785f7d-5d3c-47e9-a712-2946c8c0d3a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:16.181643 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a8785f7d-5d3c-47e9-a712-2946c8c0d3a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:16.182785 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a8785f7d-5d3c-47e9-a712-2946c8c0d3a8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.157564 May 24 15:41:16.183645 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 189/419] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:16 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:16.820901 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-da5b6e0d-ab5c-4260-b777-c3c81743b79c tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:16.821529 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-da5b6e0d-ab5c-4260-b777-c3c81743b79c tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:16.830238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-da5b6e0d-ab5c-4260-b777-c3c81743b79c tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:16.832093 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-da5b6e0d-ab5c-4260-b777-c3c81743b79c tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:16.832884 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-da5b6e0d-ab5c-4260-b777-c3c81743b79c tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:16.833375 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-da5b6e0d-ab5c-4260-b777-c3c81743b79c tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:16.908021 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-da5b6e0d-ab5c-4260-b777-c3c81743b79c tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:16.916114 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-da5b6e0d-ab5c-4260-b777-c3c81743b79c tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1211 microversion: 2.1 time: 0.099621 May 24 15:41:16.916689 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 231/420] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:16 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:17.202024 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-699a52e8-9316-4843-8626-d13e61db1e8c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:17.202604 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-699a52e8-9316-4843-8626-d13e61db1e8c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:17.209630 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-699a52e8-9316-4843-8626-d13e61db1e8c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:17.210069 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-699a52e8-9316-4843-8626-d13e61db1e8c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:17.210840 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-699a52e8-9316-4843-8626-d13e61db1e8c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:17.211242 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-699a52e8-9316-4843-8626-d13e61db1e8c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:17.341480 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-699a52e8-9316-4843-8626-d13e61db1e8c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:17.343656 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=100 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:17.353456 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-699a52e8-9316-4843-8626-d13e61db1e8c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:17.354948 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-699a52e8-9316-4843-8626-d13e61db1e8c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:17.356167 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-699a52e8-9316-4843-8626-d13e61db1e8c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.158096 May 24 15:41:17.356944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 190/421] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:17 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:17.933615 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f7eabb2a-a564-4c7e-899c-be74b949757d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:17.934284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f7eabb2a-a564-4c7e-899c-be74b949757d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:17.940359 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f7eabb2a-a564-4c7e-899c-be74b949757d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:17.940799 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f7eabb2a-a564-4c7e-899c-be74b949757d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:17.941669 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f7eabb2a-a564-4c7e-899c-be74b949757d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:17.942094 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f7eabb2a-a564-4c7e-899c-be74b949757d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.027027 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f7eabb2a-a564-4c7e-899c-be74b949757d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:18.029502 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:18.037001 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f7eabb2a-a564-4c7e-899c-be74b949757d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1285 microversion: 2.1 time: 0.107245 May 24 15:41:18.037569 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 232/422] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:17 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:18.335898 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-479d198a-fc71-4708-ae92-991236b3871a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "269335e6-e7ab-4e74-baf5-9f652fa434c6", "device": "/dev/sdb"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:18.341656 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-479d198a-fc71-4708-ae92-991236b3871a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:18.349146 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-479d198a-fc71-4708-ae92-991236b3871a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.349668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-479d198a-fc71-4708-ae92-991236b3871a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.350523 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-479d198a-fc71-4708-ae92-991236b3871a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.351034 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-479d198a-fc71-4708-ae92-991236b3871a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.375123 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-92b54073-6bc1-4df9-a996-d5db08cf22e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:18.376212 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-92b54073-6bc1-4df9-a996-d5db08cf22e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:18.389237 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-92b54073-6bc1-4df9-a996-d5db08cf22e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.400124 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-92b54073-6bc1-4df9-a996-d5db08cf22e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.401067 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-92b54073-6bc1-4df9-a996-d5db08cf22e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:18.401719 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-92b54073-6bc1-4df9-a996-d5db08cf22e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:18.627347 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-92b54073-6bc1-4df9-a996-d5db08cf22e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:18.638994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-92b54073-6bc1-4df9-a996-d5db08cf22e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:18.640856 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-92b54073-6bc1-4df9-a996-d5db08cf22e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:18.644676 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-92b54073-6bc1-4df9-a996-d5db08cf22e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.272694 May 24 15:41:18.645969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 233/423] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:18 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:18.707449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-479d198a-fc71-4708-ae92-991236b3871a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "POST /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376945 May 24 15:41:18.708491 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 191/424] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:41:18 2022] POST /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:41:19.055188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cee27c22-117b-45c2-a375-b4ea2d794979 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:19.055791 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-cee27c22-117b-45c2-a375-b4ea2d794979 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:19.064438 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cee27c22-117b-45c2-a375-b4ea2d794979 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.065214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cee27c22-117b-45c2-a375-b4ea2d794979 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.066378 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cee27c22-117b-45c2-a375-b4ea2d794979 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.066961 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cee27c22-117b-45c2-a375-b4ea2d794979 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.343805 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-cee27c22-117b-45c2-a375-b4ea2d794979 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:19.351373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cee27c22-117b-45c2-a375-b4ea2d794979 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1315 microversion: 2.1 time: 0.300000 May 24 15:41:19.351937 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 234/425] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:19 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:19.665286 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-cb916bc7-400a-4a08-8f90-34cfe5b39efd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:19.666083 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-cb916bc7-400a-4a08-8f90-34cfe5b39efd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:19.672801 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cb916bc7-400a-4a08-8f90-34cfe5b39efd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.673243 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cb916bc7-400a-4a08-8f90-34cfe5b39efd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.674061 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cb916bc7-400a-4a08-8f90-34cfe5b39efd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.674589 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cb916bc7-400a-4a08-8f90-34cfe5b39efd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.815722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-61c8ceb6-c299-46ab-b3fb-b20e7eedebee req-f1d27a09-4bc7-423b-a454-e9d65514960a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08e53b2-ee00-41ba-9189-a7193bb62d73", "tag": "79edbe8a-3ab9-40f3-9023-617b5cf0b710"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:19.830734 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-61c8ceb6-c299-46ab-b3fb-b20e7eedebee req-f1d27a09-4bc7-423b-a454-e9d65514960a service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:19.837132 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-61c8ceb6-c299-46ab-b3fb-b20e7eedebee req-f1d27a09-4bc7-423b-a454-e9d65514960a service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:19.857362 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-61c8ceb6-c299-46ab-b3fb-b20e7eedebee req-f1d27a09-4bc7-423b-a454-e9d65514960a service nova] Creating event network-changed:79edbe8a-3ab9-40f3-9023-617b5cf0b710 for instance c08e53b2-ee00-41ba-9189-a7193bb62d73 on hv-cinder-84315 May 24 15:41:19.867120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-61c8ceb6-c299-46ab-b3fb-b20e7eedebee req-f1d27a09-4bc7-423b-a454-e9d65514960a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055452 May 24 15:41:19.869195 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 235/426] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:41:19.950869 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-cb916bc7-400a-4a08-8f90-34cfe5b39efd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:19.961129 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-cb916bc7-400a-4a08-8f90-34cfe5b39efd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:19.962625 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-cb916bc7-400a-4a08-8f90-34cfe5b39efd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:19.964480 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-cb916bc7-400a-4a08-8f90-34cfe5b39efd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.303402 May 24 15:41:19.965052 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 192/427] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:19 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:20.369306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d2ee9869-d4cb-476f-93b8-67c7427e39af tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:20.369874 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d2ee9869-d4cb-476f-93b8-67c7427e39af tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:20.376341 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d2ee9869-d4cb-476f-93b8-67c7427e39af tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.376776 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d2ee9869-d4cb-476f-93b8-67c7427e39af tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:20.377531 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d2ee9869-d4cb-476f-93b8-67c7427e39af tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.377986 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d2ee9869-d4cb-476f-93b8-67c7427e39af tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:20.511423 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d2ee9869-d4cb-476f-93b8-67c7427e39af tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:20.520437 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d2ee9869-d4cb-476f-93b8-67c7427e39af tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1315 microversion: 2.1 time: 0.155526 May 24 15:41:20.520997 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 236/428] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:20 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:20.983511 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3c58f565-155e-4663-83ec-dfbe1052c4ce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:20.984138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3c58f565-155e-4663-83ec-dfbe1052c4ce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:20.991139 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3c58f565-155e-4663-83ec-dfbe1052c4ce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.991584 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3c58f565-155e-4663-83ec-dfbe1052c4ce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:20.992459 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3c58f565-155e-4663-83ec-dfbe1052c4ce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:20.992887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3c58f565-155e-4663-83ec-dfbe1052c4ce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:21.142767 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-3c58f565-155e-4663-83ec-dfbe1052c4ce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:21.152730 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-3c58f565-155e-4663-83ec-dfbe1052c4ce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:21.154204 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-3c58f565-155e-4663-83ec-dfbe1052c4ce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:21.155584 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3c58f565-155e-4663-83ec-dfbe1052c4ce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.176166 May 24 15:41:21.156197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 193/429] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:20 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:21.537407 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a854e423-5e01-4a5d-bd59-0988dbe18c8f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:21.538041 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a854e423-5e01-4a5d-bd59-0988dbe18c8f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:21.544346 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a854e423-5e01-4a5d-bd59-0988dbe18c8f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:21.544790 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a854e423-5e01-4a5d-bd59-0988dbe18c8f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:21.545535 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a854e423-5e01-4a5d-bd59-0988dbe18c8f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:21.545956 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a854e423-5e01-4a5d-bd59-0988dbe18c8f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:21.710725 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a854e423-5e01-4a5d-bd59-0988dbe18c8f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:21.718586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a854e423-5e01-4a5d-bd59-0988dbe18c8f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1315 microversion: 2.1 time: 0.185107 May 24 15:41:21.719131 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 237/430] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:21 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:22.176589 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c48df620-7734-4e39-b92f-18a018b97108 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:22.177330 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c48df620-7734-4e39-b92f-18a018b97108 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:22.184269 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c48df620-7734-4e39-b92f-18a018b97108 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.184723 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c48df620-7734-4e39-b92f-18a018b97108 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.185509 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c48df620-7734-4e39-b92f-18a018b97108 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.185970 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c48df620-7734-4e39-b92f-18a018b97108 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.324063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c48df620-7734-4e39-b92f-18a018b97108 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:22.335279 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c48df620-7734-4e39-b92f-18a018b97108 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:22.336793 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c48df620-7734-4e39-b92f-18a018b97108 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:22.338041 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c48df620-7734-4e39-b92f-18a018b97108 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.166944 May 24 15:41:22.338584 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 194/431] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:22 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:22.735887 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2b2e4800-89d9-4470-b318-f877fc0031ce tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:22.736530 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2b2e4800-89d9-4470-b318-f877fc0031ce tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:22.742841 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2b2e4800-89d9-4470-b318-f877fc0031ce tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.743281 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2b2e4800-89d9-4470-b318-f877fc0031ce tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.744089 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2b2e4800-89d9-4470-b318-f877fc0031ce tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:22.744491 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2b2e4800-89d9-4470-b318-f877fc0031ce tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:22.901586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2b2e4800-89d9-4470-b318-f877fc0031ce tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:22.911689 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2b2e4800-89d9-4470-b318-f877fc0031ce tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1315 microversion: 2.1 time: 0.179319 May 24 15:41:22.912397 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 238/432] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:22 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:23.356154 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-96d55dba-20ab-4219-ae95-5f7c643d8579 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:23.356753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-96d55dba-20ab-4219-ae95-5f7c643d8579 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:23.359149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:23.364854 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-96d55dba-20ab-4219-ae95-5f7c643d8579 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:23.365288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-96d55dba-20ab-4219-ae95-5f7c643d8579 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:23.366046 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-96d55dba-20ab-4219-ae95-5f7c643d8579 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:23.366470 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-96d55dba-20ab-4219-ae95-5f7c643d8579 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:23.381721 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=6 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:23.498633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-96d55dba-20ab-4219-ae95-5f7c643d8579 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:23.507641 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-96d55dba-20ab-4219-ae95-5f7c643d8579 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:23.509172 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-96d55dba-20ab-4219-ae95-5f7c643d8579 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:23.510343 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-96d55dba-20ab-4219-ae95-5f7c643d8579 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.158155 May 24 15:41:23.510929 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 195/433] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:23 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:23.933383 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8593a9f4-d9ec-4114-b315-6752476a3d90 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:23.933949 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8593a9f4-d9ec-4114-b315-6752476a3d90 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:23.935923 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=6 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:23.942168 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8593a9f4-d9ec-4114-b315-6752476a3d90 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:23.942168 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8593a9f4-d9ec-4114-b315-6752476a3d90 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:23.942926 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8593a9f4-d9ec-4114-b315-6752476a3d90 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:23.943331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8593a9f4-d9ec-4114-b315-6752476a3d90 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:24.082527 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8593a9f4-d9ec-4114-b315-6752476a3d90 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:24.090721 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8593a9f4-d9ec-4114-b315-6752476a3d90 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1315 microversion: 2.1 time: 0.161217 May 24 15:41:24.091503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 239/434] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:23 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:24.529124 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-50a6bb1d-16cb-4f6f-a416-a940ea33db42 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:24.529734 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-50a6bb1d-16cb-4f6f-a416-a940ea33db42 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:24.536510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-50a6bb1d-16cb-4f6f-a416-a940ea33db42 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:24.536950 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-50a6bb1d-16cb-4f6f-a416-a940ea33db42 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:24.537691 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-50a6bb1d-16cb-4f6f-a416-a940ea33db42 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:24.538122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-50a6bb1d-16cb-4f6f-a416-a940ea33db42 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:24.676532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-50a6bb1d-16cb-4f6f-a416-a940ea33db42 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:24.687203 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-50a6bb1d-16cb-4f6f-a416-a940ea33db42 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:24.688843 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-50a6bb1d-16cb-4f6f-a416-a940ea33db42 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:24.692604 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-50a6bb1d-16cb-4f6f-a416-a940ea33db42 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.164807 May 24 15:41:24.692604 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 196/435] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:24 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:25.108753 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b28c04d2-7a65-404f-a804-4ff8958246f8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:25.109357 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b28c04d2-7a65-404f-a804-4ff8958246f8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:25.116532 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b28c04d2-7a65-404f-a804-4ff8958246f8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.117000 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b28c04d2-7a65-404f-a804-4ff8958246f8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.117734 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b28c04d2-7a65-404f-a804-4ff8958246f8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.118149 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b28c04d2-7a65-404f-a804-4ff8958246f8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.259854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b28c04d2-7a65-404f-a804-4ff8958246f8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:25.268225 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b28c04d2-7a65-404f-a804-4ff8958246f8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1315 microversion: 2.1 time: 0.163932 May 24 15:41:25.269357 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 240/436] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:25 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:25.397190 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-18c4a9ae-5e59-4ce8-bc93-953c50ef207d req-05cd7c86-3d30-416b-a017-02ddd273ba3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08e53b2-ee00-41ba-9189-a7193bb62d73", "name": "network-vif-plugged", "status": "completed", "tag": "79edbe8a-3ab9-40f3-9023-617b5cf0b710"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:25.405308 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-18c4a9ae-5e59-4ce8-bc93-953c50ef207d req-05cd7c86-3d30-416b-a017-02ddd273ba3d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.405741 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-18c4a9ae-5e59-4ce8-bc93-953c50ef207d req-05cd7c86-3d30-416b-a017-02ddd273ba3d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.417198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-18c4a9ae-5e59-4ce8-bc93-953c50ef207d req-05cd7c86-3d30-416b-a017-02ddd273ba3d service nova] Creating event network-vif-plugged:79edbe8a-3ab9-40f3-9023-617b5cf0b710 for instance c08e53b2-ee00-41ba-9189-a7193bb62d73 on hv-cinder-84315 May 24 15:41:25.422880 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-18c4a9ae-5e59-4ce8-bc93-953c50ef207d req-05cd7c86-3d30-416b-a017-02ddd273ba3d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029423 May 24 15:41:25.423760 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 197/437] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:41:25.712231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7e014fa6-e798-4882-84b8-94f84e3dd514 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:25.712822 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7e014fa6-e798-4882-84b8-94f84e3dd514 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:25.719554 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e014fa6-e798-4882-84b8-94f84e3dd514 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.720261 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e014fa6-e798-4882-84b8-94f84e3dd514 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.721280 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e014fa6-e798-4882-84b8-94f84e3dd514 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:25.721978 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e014fa6-e798-4882-84b8-94f84e3dd514 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:25.856677 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7e014fa6-e798-4882-84b8-94f84e3dd514 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:25.865631 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7e014fa6-e798-4882-84b8-94f84e3dd514 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:25.867128 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7e014fa6-e798-4882-84b8-94f84e3dd514 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:25.868380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7e014fa6-e798-4882-84b8-94f84e3dd514 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.160106 May 24 15:41:25.869281 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 241/438] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:25 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:26.286769 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e733ea98-60cd-43fe-96b7-db64a4335985 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:26.287459 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e733ea98-60cd-43fe-96b7-db64a4335985 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:26.294415 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e733ea98-60cd-43fe-96b7-db64a4335985 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:26.294854 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e733ea98-60cd-43fe-96b7-db64a4335985 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:26.295612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e733ea98-60cd-43fe-96b7-db64a4335985 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:26.296060 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e733ea98-60cd-43fe-96b7-db64a4335985 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:26.435550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e733ea98-60cd-43fe-96b7-db64a4335985 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:26.444157 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e733ea98-60cd-43fe-96b7-db64a4335985 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1315 microversion: 2.1 time: 0.162050 May 24 15:41:26.444719 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 198/439] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:26 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:26.889960 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-aa2856db-9d05-4d22-a031-429958a7ec7f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:26.890592 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-aa2856db-9d05-4d22-a031-429958a7ec7f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:26.898144 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aa2856db-9d05-4d22-a031-429958a7ec7f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:26.898585 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aa2856db-9d05-4d22-a031-429958a7ec7f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:26.899353 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aa2856db-9d05-4d22-a031-429958a7ec7f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:26.899784 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aa2856db-9d05-4d22-a031-429958a7ec7f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.043465 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-aa2856db-9d05-4d22-a031-429958a7ec7f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:27.052236 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-aa2856db-9d05-4d22-a031-429958a7ec7f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:27.053699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-aa2856db-9d05-4d22-a031-429958a7ec7f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:27.054835 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-aa2856db-9d05-4d22-a031-429958a7ec7f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.169051 May 24 15:41:27.055390 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 242/440] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:26 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:27.470594 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-75a85b28-a416-4382-ae0c-2ffc1b5c674f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:27.471574 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-75a85b28-a416-4382-ae0c-2ffc1b5c674f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:27.482574 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75a85b28-a416-4382-ae0c-2ffc1b5c674f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:27.483408 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75a85b28-a416-4382-ae0c-2ffc1b5c674f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.484609 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75a85b28-a416-4382-ae0c-2ffc1b5c674f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:27.485324 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75a85b28-a416-4382-ae0c-2ffc1b5c674f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:27.616602 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-75a85b28-a416-4382-ae0c-2ffc1b5c674f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:27.624237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-75a85b28-a416-4382-ae0c-2ffc1b5c674f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1315 microversion: 2.1 time: 0.160040 May 24 15:41:27.624837 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 199/441] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:27 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:28.076835 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-5a8cb347-c6c9-4cc3-bd18-998f2ecab580 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:28.077774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-5a8cb347-c6c9-4cc3-bd18-998f2ecab580 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:28.087741 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5a8cb347-c6c9-4cc3-bd18-998f2ecab580 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:28.088532 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5a8cb347-c6c9-4cc3-bd18-998f2ecab580 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:28.089767 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5a8cb347-c6c9-4cc3-bd18-998f2ecab580 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:28.090477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5a8cb347-c6c9-4cc3-bd18-998f2ecab580 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:28.228706 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-5a8cb347-c6c9-4cc3-bd18-998f2ecab580 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:28.237458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-5a8cb347-c6c9-4cc3-bd18-998f2ecab580 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:28.239055 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-5a8cb347-c6c9-4cc3-bd18-998f2ecab580 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:28.240238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-5a8cb347-c6c9-4cc3-bd18-998f2ecab580 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.169965 May 24 15:41:28.240786 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 243/442] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:28 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:28.644426 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a6132ee6-1163-409e-a0bb-22bc618d4563 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:28.645199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a6132ee6-1163-409e-a0bb-22bc618d4563 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:28.655697 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a6132ee6-1163-409e-a0bb-22bc618d4563 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:28.656436 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a6132ee6-1163-409e-a0bb-22bc618d4563 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:28.657573 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a6132ee6-1163-409e-a0bb-22bc618d4563 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:28.658277 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a6132ee6-1163-409e-a0bb-22bc618d4563 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:28.801145 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a6132ee6-1163-409e-a0bb-22bc618d4563 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:28.812474 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a6132ee6-1163-409e-a0bb-22bc618d4563 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1315 microversion: 2.1 time: 0.173710 May 24 15:41:28.813236 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 200/443] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:28 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:29.263314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-44dc2ed6-83c1-4f55-b518-38ec04418e76 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:29.264359 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-44dc2ed6-83c1-4f55-b518-38ec04418e76 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:29.274894 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44dc2ed6-83c1-4f55-b518-38ec04418e76 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.275769 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44dc2ed6-83c1-4f55-b518-38ec04418e76 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.277154 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44dc2ed6-83c1-4f55-b518-38ec04418e76 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.277861 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44dc2ed6-83c1-4f55-b518-38ec04418e76 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.412731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-44dc2ed6-83c1-4f55-b518-38ec04418e76 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:29.421468 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-44dc2ed6-83c1-4f55-b518-38ec04418e76 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:29.422946 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-44dc2ed6-83c1-4f55-b518-38ec04418e76 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:29.424105 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-44dc2ed6-83c1-4f55-b518-38ec04418e76 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.167886 May 24 15:41:29.425161 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 244/444] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:29 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:29.833720 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-57d50410-8ff5-45b5-bf5c-d57168d38a49 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:29.834391 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-57d50410-8ff5-45b5-bf5c-d57168d38a49 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:29.843032 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-57d50410-8ff5-45b5-bf5c-d57168d38a49 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.843562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-57d50410-8ff5-45b5-bf5c-d57168d38a49 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.844505 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-57d50410-8ff5-45b5-bf5c-d57168d38a49 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:29.845015 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-57d50410-8ff5-45b5-bf5c-d57168d38a49 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:29.981435 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-57d50410-8ff5-45b5-bf5c-d57168d38a49 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:29.989598 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-57d50410-8ff5-45b5-bf5c-d57168d38a49 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1315 microversion: 2.1 time: 0.162114 May 24 15:41:29.990146 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 201/445] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:29 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:30.340049 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-953dd5df-ba67-46e4-b084-1b5c915142c1 req-f540513c-e8c3-4e31-b86d-3d32045a1ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2694ac-4a5e-4cfa-aaf8-877c8285148a", "name": "network-vif-plugged", "status": "completed", "tag": "b4136280-42c5-46f1-8248-0dcb997d0277"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:30.343494 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:30.351395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-953dd5df-ba67-46e4-b084-1b5c915142c1 req-f540513c-e8c3-4e31-b86d-3d32045a1ff4 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:30.351966 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-953dd5df-ba67-46e4-b084-1b5c915142c1 req-f540513c-e8c3-4e31-b86d-3d32045a1ff4 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:30.365337 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-953dd5df-ba67-46e4-b084-1b5c915142c1 req-f540513c-e8c3-4e31-b86d-3d32045a1ff4 service nova] Creating event network-vif-plugged:b4136280-42c5-46f1-8248-0dcb997d0277 for instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a on hv-cinder-84315 May 24 15:41:30.370464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-953dd5df-ba67-46e4-b084-1b5c915142c1 req-f540513c-e8c3-4e31-b86d-3d32045a1ff4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034160 May 24 15:41:30.371449 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 245/446] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:41:30.443161 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-03dcbb94-efdf-4174-ba65-a6229b1c0a67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:30.444053 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-03dcbb94-efdf-4174-ba65-a6229b1c0a67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:30.450741 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-03dcbb94-efdf-4174-ba65-a6229b1c0a67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:30.451183 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-03dcbb94-efdf-4174-ba65-a6229b1c0a67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:30.451944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-03dcbb94-efdf-4174-ba65-a6229b1c0a67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:30.452447 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-03dcbb94-efdf-4174-ba65-a6229b1c0a67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:30.589040 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-03dcbb94-efdf-4174-ba65-a6229b1c0a67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:30.602094 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-03dcbb94-efdf-4174-ba65-a6229b1c0a67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:30.604450 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-03dcbb94-efdf-4174-ba65-a6229b1c0a67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:30.606160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-03dcbb94-efdf-4174-ba65-a6229b1c0a67 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.166946 May 24 15:41:30.606935 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 202/447] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:30 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:31.011565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ead8bf72-9988-43e0-97e8-5823d319e11e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:31.012319 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ead8bf72-9988-43e0-97e8-5823d319e11e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:31.019195 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ead8bf72-9988-43e0-97e8-5823d319e11e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.019636 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ead8bf72-9988-43e0-97e8-5823d319e11e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.020462 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ead8bf72-9988-43e0-97e8-5823d319e11e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.020882 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ead8bf72-9988-43e0-97e8-5823d319e11e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.156534 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ead8bf72-9988-43e0-97e8-5823d319e11e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:31.164073 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ead8bf72-9988-43e0-97e8-5823d319e11e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1463 microversion: 2.1 time: 0.156861 May 24 15:41:31.164639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 246/448] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:31 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:31.205081 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5c5ce6de-5573-4e50-afe9-c803fb27b6eb tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:31.205626 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5c5ce6de-5573-4e50-afe9-c803fb27b6eb tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:31.212466 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5c5ce6de-5573-4e50-afe9-c803fb27b6eb tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.212904 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5c5ce6de-5573-4e50-afe9-c803fb27b6eb tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.213650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5c5ce6de-5573-4e50-afe9-c803fb27b6eb tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.214080 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5c5ce6de-5573-4e50-afe9-c803fb27b6eb tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.239280 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5c5ce6de-5573-4e50-afe9-c803fb27b6eb tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:41:31.316561 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5c5ce6de-5573-4e50-afe9-c803fb27b6eb tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 204 len: 0 microversion: 2.1 time: 0.115024 May 24 15:41:31.317042 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 203/449] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:41:31 2022] DELETE /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:41:31.325056 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-44134c27-6eae-41e0-aee3-136c3e1ee774 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:31.325657 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-44134c27-6eae-41e0-aee3-136c3e1ee774 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:31.331687 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44134c27-6eae-41e0-aee3-136c3e1ee774 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.332152 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44134c27-6eae-41e0-aee3-136c3e1ee774 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.332906 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44134c27-6eae-41e0-aee3-136c3e1ee774 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.333325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44134c27-6eae-41e0-aee3-136c3e1ee774 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.481919 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-44134c27-6eae-41e0-aee3-136c3e1ee774 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:31.492984 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-44134c27-6eae-41e0-aee3-136c3e1ee774 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1469 microversion: 2.1 time: 0.171407 May 24 15:41:31.493776 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 247/450] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:31 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:31.627414 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-fc754ba6-a7b0-41d6-b233-8d9a41a51da2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:31.628120 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-fc754ba6-a7b0-41d6-b233-8d9a41a51da2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:31.634511 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fc754ba6-a7b0-41d6-b233-8d9a41a51da2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.634950 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fc754ba6-a7b0-41d6-b233-8d9a41a51da2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:31.635698 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fc754ba6-a7b0-41d6-b233-8d9a41a51da2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:31.636163 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fc754ba6-a7b0-41d6-b233-8d9a41a51da2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.011788 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-fc754ba6-a7b0-41d6-b233-8d9a41a51da2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:32.023347 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-fc754ba6-a7b0-41d6-b233-8d9a41a51da2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:32.024887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-fc754ba6-a7b0-41d6-b233-8d9a41a51da2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:32.026049 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-fc754ba6-a7b0-41d6-b233-8d9a41a51da2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.403035 May 24 15:41:32.026610 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 204/451] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:31 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:32.517934 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-03fd1bc9-9814-4cbc-aa63-d6e979d0f027 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:32.519257 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-03fd1bc9-9814-4cbc-aa63-d6e979d0f027 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:32.529749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-03fd1bc9-9814-4cbc-aa63-d6e979d0f027 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:32.530481 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-03fd1bc9-9814-4cbc-aa63-d6e979d0f027 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.531797 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-03fd1bc9-9814-4cbc-aa63-d6e979d0f027 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:32.532605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-03fd1bc9-9814-4cbc-aa63-d6e979d0f027 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:32.669684 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-03fd1bc9-9814-4cbc-aa63-d6e979d0f027 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:32.679021 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-03fd1bc9-9814-4cbc-aa63-d6e979d0f027 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1469 microversion: 2.1 time: 0.167669 May 24 15:41:32.679568 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 248/452] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:32 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:33.045229 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-563c2ecf-a9a8-4a35-b0bd-185744b33f6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:33.045808 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-563c2ecf-a9a8-4a35-b0bd-185744b33f6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:33.053288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-563c2ecf-a9a8-4a35-b0bd-185744b33f6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.053773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-563c2ecf-a9a8-4a35-b0bd-185744b33f6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.054604 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-563c2ecf-a9a8-4a35-b0bd-185744b33f6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.055070 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-563c2ecf-a9a8-4a35-b0bd-185744b33f6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.057877 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:33.189986 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-563c2ecf-a9a8-4a35-b0bd-185744b33f6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:33.198483 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-563c2ecf-a9a8-4a35-b0bd-185744b33f6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:33.199948 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-563c2ecf-a9a8-4a35-b0bd-185744b33f6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:33.201127 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-563c2ecf-a9a8-4a35-b0bd-185744b33f6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.160056 May 24 15:41:33.201682 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 205/453] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:33 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:33.696623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fe867537-c512-4467-bca0-670554bfb780 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:33.697218 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fe867537-c512-4467-bca0-670554bfb780 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:33.703711 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe867537-c512-4467-bca0-670554bfb780 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.704187 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe867537-c512-4467-bca0-670554bfb780 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.704934 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe867537-c512-4467-bca0-670554bfb780 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:33.705357 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe867537-c512-4467-bca0-670554bfb780 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:33.844600 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fe867537-c512-4467-bca0-670554bfb780 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:33.853547 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fe867537-c512-4467-bca0-670554bfb780 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1469 microversion: 2.1 time: 0.160815 May 24 15:41:33.854119 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 249/454] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:33 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:34.219522 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9d993fd5-db51-4da0-9975-d8c98d4c4b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:34.220132 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9d993fd5-db51-4da0-9975-d8c98d4c4b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:34.227007 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9d993fd5-db51-4da0-9975-d8c98d4c4b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.227454 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9d993fd5-db51-4da0-9975-d8c98d4c4b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.228246 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9d993fd5-db51-4da0-9975-d8c98d4c4b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.228676 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9d993fd5-db51-4da0-9975-d8c98d4c4b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.361139 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9d993fd5-db51-4da0-9975-d8c98d4c4b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:34.370490 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9d993fd5-db51-4da0-9975-d8c98d4c4b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:34.371967 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9d993fd5-db51-4da0-9975-d8c98d4c4b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:34.373176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9d993fd5-db51-4da0-9975-d8c98d4c4b80 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.158240 May 24 15:41:34.373702 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 206/455] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:34 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:34.872540 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2bc6617a-14bc-42a3-8146-f5e0aa70c65d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:34.873321 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2bc6617a-14bc-42a3-8146-f5e0aa70c65d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:34.881575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2bc6617a-14bc-42a3-8146-f5e0aa70c65d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.882140 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2bc6617a-14bc-42a3-8146-f5e0aa70c65d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:34.883129 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2bc6617a-14bc-42a3-8146-f5e0aa70c65d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:34.883702 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2bc6617a-14bc-42a3-8146-f5e0aa70c65d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:35.023313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2bc6617a-14bc-42a3-8146-f5e0aa70c65d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:35.025820 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=100 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:35.032661 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2bc6617a-14bc-42a3-8146-f5e0aa70c65d tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1469 microversion: 2.1 time: 0.165267 May 24 15:41:35.033240 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 250/456] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:34 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:35.395477 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-13ad6b9e-51f3-432f-b1b8-787cc8768060 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:35.396813 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-13ad6b9e-51f3-432f-b1b8-787cc8768060 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:35.407609 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13ad6b9e-51f3-432f-b1b8-787cc8768060 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:35.408429 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13ad6b9e-51f3-432f-b1b8-787cc8768060 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:35.409708 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13ad6b9e-51f3-432f-b1b8-787cc8768060 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:35.410363 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13ad6b9e-51f3-432f-b1b8-787cc8768060 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:35.540495 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-13ad6b9e-51f3-432f-b1b8-787cc8768060 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:35.549199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-13ad6b9e-51f3-432f-b1b8-787cc8768060 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:35.550840 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-13ad6b9e-51f3-432f-b1b8-787cc8768060 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:35.552191 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-13ad6b9e-51f3-432f-b1b8-787cc8768060 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.163187 May 24 15:41:35.552752 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 207/457] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:35 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:35.873701 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-877340863", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-466910550", "security_groups": [{"name": "tempest-secgroup-smoke-1280392271"}], "block_device_mapping_v2": [{"uuid": "7772a0f8-e069-4de1-837a-c0b6269b0c6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba8b5a97-3a6a-415b-bd0c-40ca3fe3e6b1"}]}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:35.996120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] validate_networks() for [('ba8b5a97-3a6a-415b-bd0c-40ca3fe3e6b1', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:41:36.050737 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7297b1d7-3488-4905-9f6a-983e3265bcb0 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:36.051342 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7297b1d7-3488-4905-9f6a-983e3265bcb0 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:36.057792 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7297b1d7-3488-4905-9f6a-983e3265bcb0 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:36.058231 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7297b1d7-3488-4905-9f6a-983e3265bcb0 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:36.058989 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7297b1d7-3488-4905-9f6a-983e3265bcb0 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:36.059434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7297b1d7-3488-4905-9f6a-983e3265bcb0 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:36.249621 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7297b1d7-3488-4905-9f6a-983e3265bcb0 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:36.257681 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7297b1d7-3488-4905-9f6a-983e3265bcb0 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1469 microversion: 2.1 time: 0.210889 May 24 15:41:36.258262 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 208/458] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:36 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:36.418274 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:41:36.418697 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:41:36.419165 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:41:36.419567 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:41:36.419972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:41:36.429903 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:36.430344 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:36.431132 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:36.431559 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:36.449937 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Getting quotas for project dc2810000275432fb1337151b6883e90. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:41:36.454282 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Getting quotas for user 0a3a64d88e89402b907789c7f030e080 and project dc2810000275432fb1337151b6883e90. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:41:36.515454 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:41:36.517598 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7772a0f8-e069-4de1-837a-c0b6269b0c6d',volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:41:36.574989 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bd330200-ac39-4632-aa6f-82f68c7e0212 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:36.575717 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bd330200-ac39-4632-aa6f-82f68c7e0212 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:36.583748 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bd330200-ac39-4632-aa6f-82f68c7e0212 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:36.584320 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bd330200-ac39-4632-aa6f-82f68c7e0212 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:36.585198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bd330200-ac39-4632-aa6f-82f68c7e0212 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:36.585671 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bd330200-ac39-4632-aa6f-82f68c7e0212 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:36.658334 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-138c5f4b-cbdd-4a76-95e0-b563f82aa2d0 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.790852 May 24 15:41:36.659327 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 251/459] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:41:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:41:36.669140 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a3d7606d-3945-415d-ab1c-1af32dfe7778 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:36.670497 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a3d7606d-3945-415d-ab1c-1af32dfe7778 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:36.742088 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a3d7606d-3945-415d-ab1c-1af32dfe7778 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:36.749097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a3d7606d-3945-415d-ab1c-1af32dfe7778 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1093 microversion: 2.1 time: 0.083690 May 24 15:41:36.749887 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 252/460] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:36 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:36.765165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bd330200-ac39-4632-aa6f-82f68c7e0212 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:36.774078 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bd330200-ac39-4632-aa6f-82f68c7e0212 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:36.775557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bd330200-ac39-4632-aa6f-82f68c7e0212 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:36.776810 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bd330200-ac39-4632-aa6f-82f68c7e0212 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.205855 May 24 15:41:36.777288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 209/461] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:36 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:41:37.279347 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-5269b4d4-a227-4978-a799-4b7a62b1f75e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:37.280227 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-5269b4d4-a227-4978-a799-4b7a62b1f75e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:37.291525 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5269b4d4-a227-4978-a799-4b7a62b1f75e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:37.292295 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5269b4d4-a227-4978-a799-4b7a62b1f75e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.293544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5269b4d4-a227-4978-a799-4b7a62b1f75e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:37.294260 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5269b4d4-a227-4978-a799-4b7a62b1f75e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.426385 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-5269b4d4-a227-4978-a799-4b7a62b1f75e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.434150 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-5269b4d4-a227-4978-a799-4b7a62b1f75e tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1469 microversion: 2.1 time: 0.161277 May 24 15:41:37.434716 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 253/462] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:37 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:37.766571 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c42819f7-aad6-4564-a61e-833d04511675 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:37.767133 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c42819f7-aad6-4564-a61e-833d04511675 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:37.774457 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c42819f7-aad6-4564-a61e-833d04511675 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:37.774902 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c42819f7-aad6-4564-a61e-833d04511675 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.775650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c42819f7-aad6-4564-a61e-833d04511675 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:37.776112 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c42819f7-aad6-4564-a61e-833d04511675 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.794786 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8a8a9b12-22e2-4f07-bef0-530cc767c3dd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:37.795475 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8a8a9b12-22e2-4f07-bef0-530cc767c3dd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:37.801847 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8a8a9b12-22e2-4f07-bef0-530cc767c3dd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:37.802261 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8a8a9b12-22e2-4f07-bef0-530cc767c3dd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.803052 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8a8a9b12-22e2-4f07-bef0-530cc767c3dd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:37.803478 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8a8a9b12-22e2-4f07-bef0-530cc767c3dd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:37.836592 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c42819f7-aad6-4564-a61e-833d04511675 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.844495 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c42819f7-aad6-4564-a61e-833d04511675 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1143 microversion: 2.1 time: 0.081805 May 24 15:41:37.845036 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 210/463] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:37 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:37.931088 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8a8a9b12-22e2-4f07-bef0-530cc767c3dd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.939539 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8a8a9b12-22e2-4f07-bef0-530cc767c3dd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.941079 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8a8a9b12-22e2-4f07-bef0-530cc767c3dd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:37.942360 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8a8a9b12-22e2-4f07-bef0-530cc767c3dd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.151550 May 24 15:41:37.942910 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 254/464] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:37 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:38.456338 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1e4b0a61-cc9a-46f5-860d-232ed8ee77c8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:38.457390 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1e4b0a61-cc9a-46f5-860d-232ed8ee77c8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:38.463945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1e4b0a61-cc9a-46f5-860d-232ed8ee77c8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.464500 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1e4b0a61-cc9a-46f5-860d-232ed8ee77c8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.465372 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1e4b0a61-cc9a-46f5-860d-232ed8ee77c8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.465888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1e4b0a61-cc9a-46f5-860d-232ed8ee77c8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.611786 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1e4b0a61-cc9a-46f5-860d-232ed8ee77c8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:38.621343 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1e4b0a61-cc9a-46f5-860d-232ed8ee77c8 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1469 microversion: 2.1 time: 0.168652 May 24 15:41:38.622001 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 211/465] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:38 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:38.863331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-724b835e-c509-4dd8-a6c8-981531ba024a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:38.864017 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-724b835e-c509-4dd8-a6c8-981531ba024a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:38.870544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-724b835e-c509-4dd8-a6c8-981531ba024a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.870981 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-724b835e-c509-4dd8-a6c8-981531ba024a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.871723 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-724b835e-c509-4dd8-a6c8-981531ba024a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.872184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-724b835e-c509-4dd8-a6c8-981531ba024a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.932066 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-724b835e-c509-4dd8-a6c8-981531ba024a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:38.939937 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-724b835e-c509-4dd8-a6c8-981531ba024a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1135 microversion: 2.1 time: 0.081477 May 24 15:41:38.940565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 255/466] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:38 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1135 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:38.960795 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-327480cb-928e-4c76-ba3f-937ba5474e5f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:38.961410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-327480cb-928e-4c76-ba3f-937ba5474e5f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:38.968240 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-327480cb-928e-4c76-ba3f-937ba5474e5f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.968690 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-327480cb-928e-4c76-ba3f-937ba5474e5f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:38.969447 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-327480cb-928e-4c76-ba3f-937ba5474e5f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:38.969881 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-327480cb-928e-4c76-ba3f-937ba5474e5f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.104633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-327480cb-928e-4c76-ba3f-937ba5474e5f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:39.113111 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-327480cb-928e-4c76-ba3f-937ba5474e5f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:39.114598 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-327480cb-928e-4c76-ba3f-937ba5474e5f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:39.115752 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-327480cb-928e-4c76-ba3f-937ba5474e5f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.159005 May 24 15:41:39.116357 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 212/467] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:38 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:39.641708 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-82bdbe8f-5ff9-4d19-ba93-6f3187b6bc46 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:39.642547 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-82bdbe8f-5ff9-4d19-ba93-6f3187b6bc46 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:39.651017 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-82bdbe8f-5ff9-4d19-ba93-6f3187b6bc46 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.651461 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-82bdbe8f-5ff9-4d19-ba93-6f3187b6bc46 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.652292 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-82bdbe8f-5ff9-4d19-ba93-6f3187b6bc46 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.652723 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-82bdbe8f-5ff9-4d19-ba93-6f3187b6bc46 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.785526 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-82bdbe8f-5ff9-4d19-ba93-6f3187b6bc46 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:39.793514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-82bdbe8f-5ff9-4d19-ba93-6f3187b6bc46 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1469 microversion: 2.1 time: 0.157824 May 24 15:41:39.794077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 256/468] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:39 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:39.958091 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-47059c61-5a86-40c6-8b2f-1ccb67043558 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:39.958669 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-47059c61-5a86-40c6-8b2f-1ccb67043558 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:39.966129 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-47059c61-5a86-40c6-8b2f-1ccb67043558 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.966749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-47059c61-5a86-40c6-8b2f-1ccb67043558 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:39.967356 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-47059c61-5a86-40c6-8b2f-1ccb67043558 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:39.967792 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-47059c61-5a86-40c6-8b2f-1ccb67043558 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.057673 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-47059c61-5a86-40c6-8b2f-1ccb67043558 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.072147 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-47059c61-5a86-40c6-8b2f-1ccb67043558 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1191 microversion: 2.1 time: 0.118505 May 24 15:41:40.083091 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 213/469] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:39 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1191 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:40.133721 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-44e199b9-03e5-4d8d-98ef-2abf72d8d928 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:40.134348 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-44e199b9-03e5-4d8d-98ef-2abf72d8d928 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:40.141016 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44e199b9-03e5-4d8d-98ef-2abf72d8d928 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.141426 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44e199b9-03e5-4d8d-98ef-2abf72d8d928 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.142195 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44e199b9-03e5-4d8d-98ef-2abf72d8d928 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.142940 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-44e199b9-03e5-4d8d-98ef-2abf72d8d928 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.372121 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-44e199b9-03e5-4d8d-98ef-2abf72d8d928 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.383974 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-44e199b9-03e5-4d8d-98ef-2abf72d8d928 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.385811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-44e199b9-03e5-4d8d-98ef-2abf72d8d928 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.387227 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-44e199b9-03e5-4d8d-98ef-2abf72d8d928 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1806 microversion: 2.20 time: 0.257372 May 24 15:41:40.387794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 257/470] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:40 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1806 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:40.587947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-70784a52-03b5-4c05-813a-6a1c13c764f6 req-a5d9ec19-e333-42ac-adb5-08e589504913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08e53b2-ee00-41ba-9189-a7193bb62d73", "name": "network-vif-deleted", "tag": "79edbe8a-3ab9-40f3-9023-617b5cf0b710"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:40.600447 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-70784a52-03b5-4c05-813a-6a1c13c764f6 req-a5d9ec19-e333-42ac-adb5-08e589504913 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.601238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-70784a52-03b5-4c05-813a-6a1c13c764f6 req-a5d9ec19-e333-42ac-adb5-08e589504913 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.615434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-70784a52-03b5-4c05-813a-6a1c13c764f6 req-a5d9ec19-e333-42ac-adb5-08e589504913 service nova] Creating event network-vif-deleted:79edbe8a-3ab9-40f3-9023-617b5cf0b710 for instance c08e53b2-ee00-41ba-9189-a7193bb62d73 on hv-cinder-84315 May 24 15:41:40.622179 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-70784a52-03b5-4c05-813a-6a1c13c764f6 req-a5d9ec19-e333-42ac-adb5-08e589504913 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037768 May 24 15:41:40.622960 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 214/471] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:41:40.811912 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-565f45ff-db18-4d89-a3e0-3b04c1bf8a3f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:40.812637 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-565f45ff-db18-4d89-a3e0-3b04c1bf8a3f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:40.821613 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-565f45ff-db18-4d89-a3e0-3b04c1bf8a3f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.822894 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-565f45ff-db18-4d89-a3e0-3b04c1bf8a3f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.824322 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-565f45ff-db18-4d89-a3e0-3b04c1bf8a3f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:40.824784 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-565f45ff-db18-4d89-a3e0-3b04c1bf8a3f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:40.909289 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-565f45ff-db18-4d89-a3e0-3b04c1bf8a3f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e65818d4f8416c9bc1b5491d76c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ca54924ba846d2ad7a1972f1cb351c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:40.917589 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-565f45ff-db18-4d89-a3e0-3b04c1bf8a3f tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 200 len: 1300 microversion: 2.1 time: 0.110523 May 24 15:41:40.918255 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 258/472] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:40 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:41.091061 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e823e19a-65f3-4760-b493-3ecbf0c2ec0c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:41.092828 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e823e19a-65f3-4760-b493-3ecbf0c2ec0c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:41.104369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e823e19a-65f3-4760-b493-3ecbf0c2ec0c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.106066 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e823e19a-65f3-4760-b493-3ecbf0c2ec0c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.107454 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e823e19a-65f3-4760-b493-3ecbf0c2ec0c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.107945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e823e19a-65f3-4760-b493-3ecbf0c2ec0c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.185680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e823e19a-65f3-4760-b493-3ecbf0c2ec0c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:41.193563 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e823e19a-65f3-4760-b493-3ecbf0c2ec0c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1209 microversion: 2.1 time: 0.107299 May 24 15:41:41.194132 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 215/473] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:41 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:41.406222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-406f04b7-5bb5-4611-be92-3d1e5a448b00 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:41.406833 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-406f04b7-5bb5-4611-be92-3d1e5a448b00 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:41.414566 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-406f04b7-5bb5-4611-be92-3d1e5a448b00 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.415344 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-406f04b7-5bb5-4611-be92-3d1e5a448b00 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.416134 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-406f04b7-5bb5-4611-be92-3d1e5a448b00 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.416561 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-406f04b7-5bb5-4611-be92-3d1e5a448b00 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.649582 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-406f04b7-5bb5-4611-be92-3d1e5a448b00 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:41.658892 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-406f04b7-5bb5-4611-be92-3d1e5a448b00 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:41.660613 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-406f04b7-5bb5-4611-be92-3d1e5a448b00 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:41.661904 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-406f04b7-5bb5-4611-be92-3d1e5a448b00 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1793 microversion: 2.20 time: 0.259841 May 24 15:41:41.668092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 259/474] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:41:41 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1793 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:41:41.936335 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6b4d54a6-746a-41a3-a50e-652fd1fedbc4 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:41.936961 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6b4d54a6-746a-41a3-a50e-652fd1fedbc4 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] [instance: c08e53b2-ee00-41ba-9189-a7193bb62d73] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:41.943292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6b4d54a6-746a-41a3-a50e-652fd1fedbc4 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.943951 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6b4d54a6-746a-41a3-a50e-652fd1fedbc4 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.944899 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6b4d54a6-746a-41a3-a50e-652fd1fedbc4 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:41.945481 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6b4d54a6-746a-41a3-a50e-652fd1fedbc4 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:41.971497 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-6b4d54a6-746a-41a3-a50e-652fd1fedbc4 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] HTTP exception thrown: Instance c08e53b2-ee00-41ba-9189-a7193bb62d73 could not be found. May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6b4d54a6-746a-41a3-a50e-652fd1fedbc4 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Request method failure captured: May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 HTTP/1.1 May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPyPbbplR-oA3jjFvwjX84DnZvlrebldyvHCkQiSScH70UMdeXd69VTFX2Um1GiTgM5UrPGL_HSCenoGm58Mvm0IA8JyOx9TMPSD3oKJ4_DqYgFvz49hWx01KIA3Zktj-zcEGkmXRoOCFNzddMPX_3ErsFRogsZsv4IfY6RU4i9jz1s May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: 25ca54924ba846d2ad7a1972f1cb351c May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-VolumesNegativeTest-1636500388 May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:41:41.973540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/25ca54924ba846d2ad7a1972f1cb351c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_25ca54924ba846d2ad7a1972f1cb351c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/25ca54924ba846d2ad7a1972f1cb351c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/25ca54924ba846d2ad7a1972f1cb351c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-VolumesNegativeTest-1636500388 May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: 25ca54924ba846d2ad7a1972f1cb351c May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-VolumesNegativeTest-1636500388 May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-VolumesNegativeTest-1636500388-project May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: f7e65818d4f8416c9bc1b5491d76c8ec May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-VolumesNegativeTest-1636500388-project May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance c08e53b2-ee00-41ba-9189-a7193bb62d73 could not be found. May 24 15:41:41.974982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'c08e53b2-ee00-41ba-9189-a7193bb62d73'} May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08e53b2-ee00-41ba-9189-a7193bb62d73 could not be found. May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:41:41.975945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08e53b2-ee00-41ba-9189-a7193bb62d73 could not be found. May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08e53b2-ee00-41ba-9189-a7193bb62d73 could not be found. May 24 15:41:41.977416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:41:41.979340 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6b4d54a6-746a-41a3-a50e-652fd1fedbc4 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] Returning 404 to user: Instance c08e53b2-ee00-41ba-9189-a7193bb62d73 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:41:41.980457 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6b4d54a6-746a-41a3-a50e-652fd1fedbc4 tempest-VolumesNegativeTest-1636500388 tempest-VolumesNegativeTest-1636500388-project] 10.222.0.55 "GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73" status: 404 len: 111 microversion: 2.1 time: 0.048378 May 24 15:41:41.981049 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 216/475] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:41 2022] GET /compute/v2.1/servers/c08e53b2-ee00-41ba-9189-a7193bb62d73 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:41:42.215864 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6bd9d711-340a-462b-b932-cfd276fd941d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:42.216678 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6bd9d711-340a-462b-b932-cfd276fd941d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:42.226595 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6bd9d711-340a-462b-b932-cfd276fd941d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.227456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6bd9d711-340a-462b-b932-cfd276fd941d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.228124 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6bd9d711-340a-462b-b932-cfd276fd941d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.228754 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6bd9d711-340a-462b-b932-cfd276fd941d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.445416 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6bd9d711-340a-462b-b932-cfd276fd941d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:42.453317 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6bd9d711-340a-462b-b932-cfd276fd941d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.245738 May 24 15:41:42.454003 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 260/476] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:42 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:42.583516 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-12d7be3a-e063-48fd-83f2-657746bb67f9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:42.584106 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-12d7be3a-e063-48fd-83f2-657746bb67f9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:42.594232 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12d7be3a-e063-48fd-83f2-657746bb67f9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.594650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12d7be3a-e063-48fd-83f2-657746bb67f9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.595552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12d7be3a-e063-48fd-83f2-657746bb67f9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.595851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-12d7be3a-e063-48fd-83f2-657746bb67f9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.659254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-98c94d6f-5753-45ca-8ff2-98d6847e2e26 req-565e72cc-3cdf-45e0-928b-d8bbe3471078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac339a5-757e-4d9d-9216-7a2a399b8fef", "tag": "e0ffdaca-f0bd-4260-8199-fa981543ea63"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:42.670322 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-98c94d6f-5753-45ca-8ff2-98d6847e2e26 req-565e72cc-3cdf-45e0-928b-d8bbe3471078 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:42.670986 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-98c94d6f-5753-45ca-8ff2-98d6847e2e26 req-565e72cc-3cdf-45e0-928b-d8bbe3471078 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:42.694706 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-98c94d6f-5753-45ca-8ff2-98d6847e2e26 req-565e72cc-3cdf-45e0-928b-d8bbe3471078 service nova] Creating event network-changed:e0ffdaca-f0bd-4260-8199-fa981543ea63 for instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef on hv-cinder-84315 May 24 15:41:42.700305 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-98c94d6f-5753-45ca-8ff2-98d6847e2e26 req-565e72cc-3cdf-45e0-928b-d8bbe3471078 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044518 May 24 15:41:42.703374 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 261/477] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:41:42.770982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-12d7be3a-e063-48fd-83f2-657746bb67f9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lazy-loading 'services' on Instance uuid e17e4548-782e-4115-aa63-48041fca571b {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:41:42.902558 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-12d7be3a-e063-48fd-83f2-657746bb67f9 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b/os-volume_attachments/269335e6-e7ab-4e74-baf5-9f652fa434c6" status: 202 len: 0 microversion: 2.1 time: 0.323707 May 24 15:41:42.903448 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 217/478] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:41:42 2022] DELETE /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b/os-volume_attachments/269335e6-e7ab-4e74-baf5-9f652fa434c6 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:41:43.475225 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b9843f44-13ef-4362-83ae-cf2c24ec0fa1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:43.475925 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b9843f44-13ef-4362-83ae-cf2c24ec0fa1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:43.482395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b9843f44-13ef-4362-83ae-cf2c24ec0fa1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:43.482845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b9843f44-13ef-4362-83ae-cf2c24ec0fa1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:43.483605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b9843f44-13ef-4362-83ae-cf2c24ec0fa1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:43.484082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b9843f44-13ef-4362-83ae-cf2c24ec0fa1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:43.628177 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b9843f44-13ef-4362-83ae-cf2c24ec0fa1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:43.636260 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b9843f44-13ef-4362-83ae-cf2c24ec0fa1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.168526 May 24 15:41:43.636820 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 262/479] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:43 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:44.654309 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d29da4bb-3a30-4af4-89f9-631ea049d004 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:44.654974 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d29da4bb-3a30-4af4-89f9-631ea049d004 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:44.656900 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:44.663386 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d29da4bb-3a30-4af4-89f9-631ea049d004 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:44.663822 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d29da4bb-3a30-4af4-89f9-631ea049d004 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:44.664640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d29da4bb-3a30-4af4-89f9-631ea049d004 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:44.665058 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d29da4bb-3a30-4af4-89f9-631ea049d004 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:44.811343 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d29da4bb-3a30-4af4-89f9-631ea049d004 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:44.819289 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d29da4bb-3a30-4af4-89f9-631ea049d004 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.169930 May 24 15:41:44.819941 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 218/480] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:44 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:45.119925 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-36893622-c4bf-4072-8afd-d208a2baeac2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:45.120560 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-36893622-c4bf-4072-8afd-d208a2baeac2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:45.126806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-36893622-c4bf-4072-8afd-d208a2baeac2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.127315 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-36893622-c4bf-4072-8afd-d208a2baeac2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.128237 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-36893622-c4bf-4072-8afd-d208a2baeac2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.128744 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-36893622-c4bf-4072-8afd-d208a2baeac2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.154025 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-36893622-c4bf-4072-8afd-d208a2baeac2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Going to try to terminate instance {{(pid=129340) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:41:45.242174 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-36893622-c4bf-4072-8afd-d208a2baeac2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 204 len: 0 microversion: 2.1 time: 0.126208 May 24 15:41:45.242765 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 263/481] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:41:45 2022] DELETE /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:41:45.250756 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-55123253-400c-405e-8a1b-56c51235f2ad tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:45.251357 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-55123253-400c-405e-8a1b-56c51235f2ad tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:45.257902 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-55123253-400c-405e-8a1b-56c51235f2ad tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.258341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-55123253-400c-405e-8a1b-56c51235f2ad tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.259090 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-55123253-400c-405e-8a1b-56c51235f2ad tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.259515 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-55123253-400c-405e-8a1b-56c51235f2ad tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.394548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-55123253-400c-405e-8a1b-56c51235f2ad tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:45.402652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-55123253-400c-405e-8a1b-56c51235f2ad tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1513 microversion: 2.1 time: 0.155654 May 24 15:41:45.403177 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 219/482] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:45 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:45.837699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d9fd536d-d23c-4977-8df3-1cf259a05db8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:45.838400 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d9fd536d-d23c-4977-8df3-1cf259a05db8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:45.848232 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d9fd536d-d23c-4977-8df3-1cf259a05db8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.848690 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d9fd536d-d23c-4977-8df3-1cf259a05db8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.849470 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d9fd536d-d23c-4977-8df3-1cf259a05db8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:45.849904 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d9fd536d-d23c-4977-8df3-1cf259a05db8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:45.984089 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d9fd536d-d23c-4977-8df3-1cf259a05db8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:45.992278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d9fd536d-d23c-4977-8df3-1cf259a05db8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.158746 May 24 15:41:45.992868 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 264/483] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:45 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:46.420605 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-196a04a6-e8e2-4ea2-9850-ebf0419ee2d2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:46.421224 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-196a04a6-e8e2-4ea2-9850-ebf0419ee2d2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:46.428514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-196a04a6-e8e2-4ea2-9850-ebf0419ee2d2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:46.428961 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-196a04a6-e8e2-4ea2-9850-ebf0419ee2d2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:46.429734 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-196a04a6-e8e2-4ea2-9850-ebf0419ee2d2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:46.430160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-196a04a6-e8e2-4ea2-9850-ebf0419ee2d2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:46.580650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-196a04a6-e8e2-4ea2-9850-ebf0419ee2d2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:46.589369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-196a04a6-e8e2-4ea2-9850-ebf0419ee2d2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1513 microversion: 2.1 time: 0.172740 May 24 15:41:46.589937 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 220/484] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:46 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:47.009969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ca74abfc-bfd4-4cc6-9e05-2cb0643631c2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:47.010536 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ca74abfc-bfd4-4cc6-9e05-2cb0643631c2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:47.012749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:47.013468 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=8 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:47.019291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca74abfc-bfd4-4cc6-9e05-2cb0643631c2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.019732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca74abfc-bfd4-4cc6-9e05-2cb0643631c2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.020541 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca74abfc-bfd4-4cc6-9e05-2cb0643631c2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.020966 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ca74abfc-bfd4-4cc6-9e05-2cb0643631c2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.427762 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ca74abfc-bfd4-4cc6-9e05-2cb0643631c2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:47.436059 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ca74abfc-bfd4-4cc6-9e05-2cb0643631c2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.429904 May 24 15:41:47.436756 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 265/485] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:47 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:47.606665 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e1903e9f-7e8e-45f6-972e-b9ec16f20100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:47.607321 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e1903e9f-7e8e-45f6-972e-b9ec16f20100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:47.614520 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1903e9f-7e8e-45f6-972e-b9ec16f20100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.614963 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1903e9f-7e8e-45f6-972e-b9ec16f20100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.615717 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1903e9f-7e8e-45f6-972e-b9ec16f20100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.616191 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1903e9f-7e8e-45f6-972e-b9ec16f20100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.827545 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e1903e9f-7e8e-45f6-972e-b9ec16f20100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:47.835431 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e1903e9f-7e8e-45f6-972e-b9ec16f20100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 200 len: 1513 microversion: 2.1 time: 0.232606 May 24 15:41:47.836117 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 221/486] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:47 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:47.929718 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-1c0ee9bb-6d36-4541-b1a3-44dc0e021119 req-84c14685-48fb-4cee-a5c3-6c6b6931cfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17e4548-782e-4115-aa63-48041fca571b", "name": "network-vif-deleted", "tag": "33ccd1c3-9feb-4904-8e8e-8c99baa73704"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:47.937860 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-1c0ee9bb-6d36-4541-b1a3-44dc0e021119 req-84c14685-48fb-4cee-a5c3-6c6b6931cfb7 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:47.938289 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-1c0ee9bb-6d36-4541-b1a3-44dc0e021119 req-84c14685-48fb-4cee-a5c3-6c6b6931cfb7 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:47.949778 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-1c0ee9bb-6d36-4541-b1a3-44dc0e021119 req-84c14685-48fb-4cee-a5c3-6c6b6931cfb7 service nova] Creating event network-vif-deleted:33ccd1c3-9feb-4904-8e8e-8c99baa73704 for instance e17e4548-782e-4115-aa63-48041fca571b on hv-cinder-84315 May 24 15:41:47.955005 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-1c0ee9bb-6d36-4541-b1a3-44dc0e021119 req-84c14685-48fb-4cee-a5c3-6c6b6931cfb7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029462 May 24 15:41:47.955927 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 266/487] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:41:48.263508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-187f8b79-0218-42a2-80bd-100cd1dd5895 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "054c5fd8-5054-42c5-bcb4-5818db05e074"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:48.264614 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-187f8b79-0218-42a2-80bd-100cd1dd5895 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:48.271519 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-187f8b79-0218-42a2-80bd-100cd1dd5895 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.271959 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-187f8b79-0218-42a2-80bd-100cd1dd5895 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.272777 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-187f8b79-0218-42a2-80bd-100cd1dd5895 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.273208 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-187f8b79-0218-42a2-80bd-100cd1dd5895 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.287392 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:48.456579 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-02b427ed-9d2d-4ee0-9621-ab41d958af5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:48.457671 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-02b427ed-9d2d-4ee0-9621-ab41d958af5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:48.465110 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02b427ed-9d2d-4ee0-9621-ab41d958af5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.465901 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02b427ed-9d2d-4ee0-9621-ab41d958af5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.466812 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02b427ed-9d2d-4ee0-9621-ab41d958af5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.467198 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-02b427ed-9d2d-4ee0-9621-ab41d958af5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.600013 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-187f8b79-0218-42a2-80bd-100cd1dd5895 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340524 May 24 15:41:48.600727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 222/488] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:41:48 2022] POST /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:41:48.632285 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-02b427ed-9d2d-4ee0-9621-ab41d958af5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:48.639734 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-02b427ed-9d2d-4ee0-9621-ab41d958af5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.188221 May 24 15:41:48.640534 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 267/489] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:48 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:48.855985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3e4a93ca-100b-436e-9dc7-f9927a625b56 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:48.856874 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3e4a93ca-100b-436e-9dc7-f9927a625b56 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: e17e4548-782e-4115-aa63-48041fca571b] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:48.865083 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3e4a93ca-100b-436e-9dc7-f9927a625b56 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.865636 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3e4a93ca-100b-436e-9dc7-f9927a625b56 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.866578 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3e4a93ca-100b-436e-9dc7-f9927a625b56 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:48.867115 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3e4a93ca-100b-436e-9dc7-f9927a625b56 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:48.882879 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-3e4a93ca-100b-436e-9dc7-f9927a625b56 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] HTTP exception thrown: Instance e17e4548-782e-4115-aa63-48041fca571b could not be found. May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3e4a93ca-100b-436e-9dc7-f9927a625b56 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Request method failure captured: May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b HTTP/1.1 May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPxoExmWhxvGXiP-85xoSR_lPfrdkxzdeb-313m1QfsnlNTslP6ZX3LxVlgUQgdt3XvsAR_1sRjOXvqSXYSTxdZDJNVWzoXfpH81B_ahdHSFejfdc9Cwb34dDNlN51ILsez0HpXYVtk9yYqcjiHGsT7UVOKNkVlmYY7eE1VeRXjTXjg May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: 769f37bc94e24c3482bb039c5a6e7291 May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1963881534 May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:41:48.884557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/769f37bc94e24c3482bb039c5a6e7291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_769f37bc94e24c3482bb039c5a6e7291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/769f37bc94e24c3482bb039c5a6e7291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/769f37bc94e24c3482bb039c5a6e7291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-VolumesSnapshotTestJSON-1963881534 May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: 769f37bc94e24c3482bb039c5a6e7291 May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1963881534 May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-VolumesSnapshotTestJSON-1963881534-project May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 8c940eba35194b8db4af6eaf2df8b135 May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-VolumesSnapshotTestJSON-1963881534-project May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance e17e4548-782e-4115-aa63-48041fca571b could not be found. May 24 15:41:48.886213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'e17e4548-782e-4115-aa63-48041fca571b'} May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17e4548-782e-4115-aa63-48041fca571b could not be found. May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:41:48.887255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17e4548-782e-4115-aa63-48041fca571b could not be found. May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17e4548-782e-4115-aa63-48041fca571b could not be found. May 24 15:41:48.888750 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:41:48.890100 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3e4a93ca-100b-436e-9dc7-f9927a625b56 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Returning 404 to user: Instance e17e4548-782e-4115-aa63-48041fca571b could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:41:48.890100 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3e4a93ca-100b-436e-9dc7-f9927a625b56 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b" status: 404 len: 111 microversion: 2.1 time: 0.035758 May 24 15:41:48.890100 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 223/490] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:48 2022] GET /compute/v2.1/servers/e17e4548-782e-4115-aa63-48041fca571b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:41:49.660898 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-9fc154da-553b-4ac0-8d35-4f23dd0e9f3c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:49.661533 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-9fc154da-553b-4ac0-8d35-4f23dd0e9f3c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:49.669282 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9fc154da-553b-4ac0-8d35-4f23dd0e9f3c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:49.669889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9fc154da-553b-4ac0-8d35-4f23dd0e9f3c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:49.670865 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9fc154da-553b-4ac0-8d35-4f23dd0e9f3c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:49.671456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9fc154da-553b-4ac0-8d35-4f23dd0e9f3c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:49.810021 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-9fc154da-553b-4ac0-8d35-4f23dd0e9f3c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:49.812411 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:41:49.819062 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-9fc154da-553b-4ac0-8d35-4f23dd0e9f3c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.164293 May 24 15:41:49.819617 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 268/491] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:49 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:50.837706 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7da1895d-5fe3-4706-bc04-3ecb2cded805 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:50.838529 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7da1895d-5fe3-4706-bc04-3ecb2cded805 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:50.848176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7da1895d-5fe3-4706-bc04-3ecb2cded805 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:50.848814 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7da1895d-5fe3-4706-bc04-3ecb2cded805 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:50.849889 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7da1895d-5fe3-4706-bc04-3ecb2cded805 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:50.850506 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7da1895d-5fe3-4706-bc04-3ecb2cded805 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:50.995458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7da1895d-5fe3-4706-bc04-3ecb2cded805 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:51.003245 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7da1895d-5fe3-4706-bc04-3ecb2cded805 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.170967 May 24 15:41:51.003773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 224/492] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:50 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:52.022474 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4cf6504d-492e-47fd-9b63-b5c0edde9dc2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:52.023156 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-4cf6504d-492e-47fd-9b63-b5c0edde9dc2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:52.032092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4cf6504d-492e-47fd-9b63-b5c0edde9dc2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:52.032679 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4cf6504d-492e-47fd-9b63-b5c0edde9dc2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:52.033333 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4cf6504d-492e-47fd-9b63-b5c0edde9dc2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:52.033900 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4cf6504d-492e-47fd-9b63-b5c0edde9dc2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:52.173809 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-4cf6504d-492e-47fd-9b63-b5c0edde9dc2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:52.184462 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-4cf6504d-492e-47fd-9b63-b5c0edde9dc2 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.168095 May 24 15:41:52.185337 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 269/493] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:52 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:53.205419 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a029c632-9c30-4848-addb-970962503984 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:53.206440 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a029c632-9c30-4848-addb-970962503984 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:53.213421 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a029c632-9c30-4848-addb-970962503984 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.213860 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a029c632-9c30-4848-addb-970962503984 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.214613 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a029c632-9c30-4848-addb-970962503984 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.215039 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a029c632-9c30-4848-addb-970962503984 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.351659 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a029c632-9c30-4848-addb-970962503984 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:53.363318 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a029c632-9c30-4848-addb-970962503984 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.164155 May 24 15:41:53.364232 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 225/494] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:53 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:53.563748 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-34793612-c11b-4b74-b2e0-7d55840dc5fe req-f2819933-274a-4cb3-aa4a-dbd762ea0db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac339a5-757e-4d9d-9216-7a2a399b8fef", "name": "network-vif-plugged", "status": "completed", "tag": "e0ffdaca-f0bd-4260-8199-fa981543ea63"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:53.572354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-34793612-c11b-4b74-b2e0-7d55840dc5fe req-f2819933-274a-4cb3-aa4a-dbd762ea0db4 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:53.572788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-34793612-c11b-4b74-b2e0-7d55840dc5fe req-f2819933-274a-4cb3-aa4a-dbd762ea0db4 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:53.586598 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-34793612-c11b-4b74-b2e0-7d55840dc5fe req-f2819933-274a-4cb3-aa4a-dbd762ea0db4 service nova] Creating event network-vif-plugged:e0ffdaca-f0bd-4260-8199-fa981543ea63 for instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef on hv-cinder-84315 May 24 15:41:53.590436 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-34793612-c11b-4b74-b2e0-7d55840dc5fe req-f2819933-274a-4cb3-aa4a-dbd762ea0db4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034281 May 24 15:41:53.591138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 270/495] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:41:54.389733 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-79b1843e-f561-4ab7-bb25-968debcfc20b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:54.390601 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-79b1843e-f561-4ab7-bb25-968debcfc20b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:54.399098 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-79b1843e-f561-4ab7-bb25-968debcfc20b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:54.399541 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-79b1843e-f561-4ab7-bb25-968debcfc20b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:54.400325 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-79b1843e-f561-4ab7-bb25-968debcfc20b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:54.400749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-79b1843e-f561-4ab7-bb25-968debcfc20b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:54.533053 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-79b1843e-f561-4ab7-bb25-968debcfc20b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:54.544172 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-79b1843e-f561-4ab7-bb25-968debcfc20b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.160890 May 24 15:41:54.544874 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 226/496] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:54 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:55.563614 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-708f2979-8d3c-4120-8bc9-5f96f543ea54 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:55.564346 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-708f2979-8d3c-4120-8bc9-5f96f543ea54 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:55.571204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-708f2979-8d3c-4120-8bc9-5f96f543ea54 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:55.571650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-708f2979-8d3c-4120-8bc9-5f96f543ea54 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:55.572426 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-708f2979-8d3c-4120-8bc9-5f96f543ea54 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:55.572846 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-708f2979-8d3c-4120-8bc9-5f96f543ea54 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:55.714667 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-708f2979-8d3c-4120-8bc9-5f96f543ea54 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:55.722692 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-708f2979-8d3c-4120-8bc9-5f96f543ea54 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.163477 May 24 15:41:55.723258 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 271/497] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:55 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:56.738600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4c80c984-df3d-4421-94e2-f8cb0b7b4232 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:56.739164 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-412907862", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "networks": [{"uuid": "d22bbbfe-aa37-4ce8-92c8-3aeb391d1750"}]}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:56.739544 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4c80c984-df3d-4421-94e2-f8cb0b7b4232 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:56.746052 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4c80c984-df3d-4421-94e2-f8cb0b7b4232 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:56.746491 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4c80c984-df3d-4421-94e2-f8cb0b7b4232 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:56.747238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4c80c984-df3d-4421-94e2-f8cb0b7b4232 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:56.747661 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4c80c984-df3d-4421-94e2-f8cb0b7b4232 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:56.791210 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] validate_networks() for [('d22bbbfe-aa37-4ce8-92c8-3aeb391d1750', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:41:56.965419 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4c80c984-df3d-4421-94e2-f8cb0b7b4232 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:56.973239 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4c80c984-df3d-4421-94e2-f8cb0b7b4232 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1265 microversion: 2.1 time: 0.238575 May 24 15:41:56.973801 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 227/498] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:56 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:57.196289 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:41:57.196964 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:41:57.197775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:41:57.198373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:41:57.198992 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:41:57.214167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:57.214777 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:57.216114 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:57.216760 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:57.236508 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Getting quotas for project 769f37bc94e24c3482bb039c5a6e7291. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:41:57.240807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Getting quotas for user 8c940eba35194b8db4af6eaf2df8b135 and project 769f37bc94e24c3482bb039c5a6e7291. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:41:57.252363 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:41:57.254672 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:41:57.302632 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-79f81fb0-766b-45a4-9a94-d376843ee100 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567907 May 24 15:41:57.303272 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 272/499] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:41:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:41:57.313236 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bcc7b47b-1db5-4826-b229-6a1813918a67 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:57.313845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bcc7b47b-1db5-4826-b229-6a1813918a67 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:57.366023 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bcc7b47b-1db5-4826-b229-6a1813918a67 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:57.373605 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bcc7b47b-1db5-4826-b229-6a1813918a67 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1218 microversion: 2.1 time: 0.064210 May 24 15:41:57.374168 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 228/500] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:57 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:57.991645 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-543e8a85-f962-4796-b91b-b0e4f2c5b1c6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:57.992334 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-543e8a85-f962-4796-b91b-b0e4f2c5b1c6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:57.998707 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-543e8a85-f962-4796-b91b-b0e4f2c5b1c6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:57.999159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-543e8a85-f962-4796-b91b-b0e4f2c5b1c6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:57.999952 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-543e8a85-f962-4796-b91b-b0e4f2c5b1c6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.000388 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-543e8a85-f962-4796-b91b-b0e4f2c5b1c6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.141430 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-543e8a85-f962-4796-b91b-b0e4f2c5b1c6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:58.151091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-543e8a85-f962-4796-b91b-b0e4f2c5b1c6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1451 microversion: 2.1 time: 0.164110 May 24 15:41:58.151668 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 273/501] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:57 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:58.167486 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9a1be0ce-ee66-4101-911d-bc3b7f400755 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:58.168122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9a1be0ce-ee66-4101-911d-bc3b7f400755 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:58.174816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a1be0ce-ee66-4101-911d-bc3b7f400755 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.175298 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a1be0ce-ee66-4101-911d-bc3b7f400755 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.176361 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a1be0ce-ee66-4101-911d-bc3b7f400755 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.176798 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a1be0ce-ee66-4101-911d-bc3b7f400755 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.326808 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9a1be0ce-ee66-4101-911d-bc3b7f400755 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:58.335139 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9a1be0ce-ee66-4101-911d-bc3b7f400755 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1451 microversion: 2.1 time: 0.171433 May 24 15:41:58.335713 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 229/502] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:58 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:58.390747 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c7e8536f-6042-4b21-9ae9-7f71ef367440 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:58.391461 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c7e8536f-6042-4b21-9ae9-7f71ef367440 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:58.398007 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c7e8536f-6042-4b21-9ae9-7f71ef367440 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.398447 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c7e8536f-6042-4b21-9ae9-7f71ef367440 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.399208 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c7e8536f-6042-4b21-9ae9-7f71ef367440 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:58.399634 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c7e8536f-6042-4b21-9ae9-7f71ef367440 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:58.472858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c7e8536f-6042-4b21-9ae9-7f71ef367440 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:58.480581 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c7e8536f-6042-4b21-9ae9-7f71ef367440 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1222 microversion: 2.1 time: 0.093445 May 24 15:41:58.481129 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 274/503] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:58 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:41:59.327549 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7a1a6808-b26e-4287-9e71-9e16d40c6ede tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:41:59.329550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7a1a6808-b26e-4287-9e71-9e16d40c6ede tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:59.335393 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7a1a6808-b26e-4287-9e71-9e16d40c6ede tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.335844 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7a1a6808-b26e-4287-9e71-9e16d40c6ede tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.336676 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7a1a6808-b26e-4287-9e71-9e16d40c6ede tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.337123 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7a1a6808-b26e-4287-9e71-9e16d40c6ede tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.361257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-7a1a6808-b26e-4287-9e71-9e16d40c6ede tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'flavor' on Instance uuid 3f726278-c770-47b5-86db-c95db49ba80f {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:41:59.492333 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7a1a6808-b26e-4287-9e71-9e16d40c6ede tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/action" status: 200 len: 32 microversion: 2.1 time: 0.168898 May 24 15:41:59.493389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 230/504] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:41:59 2022] POST /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:41:59.498223 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-746a8bb0-3412-4787-b0a2-dbdb88003a81 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:59.499448 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-746a8bb0-3412-4787-b0a2-dbdb88003a81 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:59.503775 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-81b9e222-5f99-4fec-a480-d3d1a6c2024a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:41:59.504591 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-81b9e222-5f99-4fec-a480-d3d1a6c2024a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:41:59.508594 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-746a8bb0-3412-4787-b0a2-dbdb88003a81 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.512483 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-746a8bb0-3412-4787-b0a2-dbdb88003a81 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.513962 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-81b9e222-5f99-4fec-a480-d3d1a6c2024a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.514416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-81b9e222-5f99-4fec-a480-d3d1a6c2024a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.515181 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-81b9e222-5f99-4fec-a480-d3d1a6c2024a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.516123 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-81b9e222-5f99-4fec-a480-d3d1a6c2024a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.516323 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-746a8bb0-3412-4787-b0a2-dbdb88003a81 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:41:59.518692 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-746a8bb0-3412-4787-b0a2-dbdb88003a81 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:41:59.659699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-746a8bb0-3412-4787-b0a2-dbdb88003a81 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:59.667282 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-746a8bb0-3412-4787-b0a2-dbdb88003a81 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1288 microversion: 2.1 time: 0.172968 May 24 15:41:59.667851 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 275/505] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:59 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1288 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:41:59.851777 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-81b9e222-5f99-4fec-a480-d3d1a6c2024a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:41:59.860368 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-81b9e222-5f99-4fec-a480-d3d1a6c2024a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.361706 May 24 15:41:59.861014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 231/506] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:41:59 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:00.685188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-9bc4a80e-09e5-4ea2-b56b-7cfa2cb4340a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:00.686502 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-9bc4a80e-09e5-4ea2-b56b-7cfa2cb4340a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:00.688556 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:00.694366 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9bc4a80e-09e5-4ea2-b56b-7cfa2cb4340a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.694807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9bc4a80e-09e5-4ea2-b56b-7cfa2cb4340a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.695569 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9bc4a80e-09e5-4ea2-b56b-7cfa2cb4340a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.695986 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9bc4a80e-09e5-4ea2-b56b-7cfa2cb4340a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.779702 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-9bc4a80e-09e5-4ea2-b56b-7cfa2cb4340a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:00.787658 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-9bc4a80e-09e5-4ea2-b56b-7cfa2cb4340a tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1276 microversion: 2.1 time: 0.106447 May 24 15:42:00.788265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 276/507] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:00 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:00.877764 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4d4b6e48-1de6-40fd-afe5-b864ab2bc47e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:00.878371 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4d4b6e48-1de6-40fd-afe5-b864ab2bc47e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:00.885569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d4b6e48-1de6-40fd-afe5-b864ab2bc47e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.886018 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d4b6e48-1de6-40fd-afe5-b864ab2bc47e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:00.886781 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d4b6e48-1de6-40fd-afe5-b864ab2bc47e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:00.887213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d4b6e48-1de6-40fd-afe5-b864ab2bc47e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.218382 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-0ea58db1-1ae3-4653-a6e9-8b0799afb400 req-0df53cf0-c2cb-4c1e-9832-5de5802752cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac339a5-757e-4d9d-9216-7a2a399b8fef", "tag": "e0ffdaca-f0bd-4260-8199-fa981543ea63"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:01.224076 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4d4b6e48-1de6-40fd-afe5-b864ab2bc47e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:01.228056 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-0ea58db1-1ae3-4653-a6e9-8b0799afb400 req-0df53cf0-c2cb-4c1e-9832-5de5802752cd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.228526 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-0ea58db1-1ae3-4653-a6e9-8b0799afb400 req-0df53cf0-c2cb-4c1e-9832-5de5802752cd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.232961 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4d4b6e48-1de6-40fd-afe5-b864ab2bc47e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.359024 May 24 15:42:01.233506 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 232/508] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:00 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:01.243155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-0ea58db1-1ae3-4653-a6e9-8b0799afb400 req-0df53cf0-c2cb-4c1e-9832-5de5802752cd service nova] Creating event network-changed:e0ffdaca-f0bd-4260-8199-fa981543ea63 for instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef on hv-cinder-84315 May 24 15:42:01.248795 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-0ea58db1-1ae3-4653-a6e9-8b0799afb400 req-0df53cf0-c2cb-4c1e-9832-5de5802752cd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034099 May 24 15:42:01.249611 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 277/509] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:01.805819 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a7c56839-1120-40dc-ba64-b849eb2d9ed8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:01.806429 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a7c56839-1120-40dc-ba64-b849eb2d9ed8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:01.812910 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a7c56839-1120-40dc-ba64-b849eb2d9ed8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.813709 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a7c56839-1120-40dc-ba64-b849eb2d9ed8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:01.815478 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a7c56839-1120-40dc-ba64-b849eb2d9ed8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:01.815917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a7c56839-1120-40dc-ba64-b849eb2d9ed8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.038983 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a7c56839-1120-40dc-ba64-b849eb2d9ed8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:02.059265 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a7c56839-1120-40dc-ba64-b849eb2d9ed8 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1318 microversion: 2.1 time: 0.257573 May 24 15:42:02.059859 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 233/510] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:01 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:02.251395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b5ab405c-5179-4a24-90c2-60525f840b51 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:02.252118 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b5ab405c-5179-4a24-90c2-60525f840b51 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:02.258540 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5ab405c-5179-4a24-90c2-60525f840b51 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:02.259013 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5ab405c-5179-4a24-90c2-60525f840b51 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.259768 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5ab405c-5179-4a24-90c2-60525f840b51 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:02.260199 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5ab405c-5179-4a24-90c2-60525f840b51 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:02.470542 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b5ab405c-5179-4a24-90c2-60525f840b51 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:02.479066 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b5ab405c-5179-4a24-90c2-60525f840b51 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.231903 May 24 15:42:02.479636 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 278/511] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:02 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:03.080893 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6a5b7d3c-cbe3-4e64-a37f-86eafd4eae65 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:03.081887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6a5b7d3c-cbe3-4e64-a37f-86eafd4eae65 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:03.092340 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6a5b7d3c-cbe3-4e64-a37f-86eafd4eae65 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.092973 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6a5b7d3c-cbe3-4e64-a37f-86eafd4eae65 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.094042 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6a5b7d3c-cbe3-4e64-a37f-86eafd4eae65 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.094646 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6a5b7d3c-cbe3-4e64-a37f-86eafd4eae65 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.243040 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6a5b7d3c-cbe3-4e64-a37f-86eafd4eae65 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:03.254628 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6a5b7d3c-cbe3-4e64-a37f-86eafd4eae65 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1318 microversion: 2.1 time: 0.180395 May 24 15:42:03.255208 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 234/512] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:03 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:03.276669 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-320f906f-8e3f-49fc-9a59-9928e735184b req-3ca16169-535c-4d7b-909b-d2f3a8307767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de41ca65-2b6d-4244-94d4-76d9cdf3bf12", "tag": "ce97ee31-f2ad-40e1-806b-ac6283c25108"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:03.287395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-320f906f-8e3f-49fc-9a59-9928e735184b req-3ca16169-535c-4d7b-909b-d2f3a8307767 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.287835 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-320f906f-8e3f-49fc-9a59-9928e735184b req-3ca16169-535c-4d7b-909b-d2f3a8307767 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.299947 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-320f906f-8e3f-49fc-9a59-9928e735184b req-3ca16169-535c-4d7b-909b-d2f3a8307767 service nova] Creating event network-changed:ce97ee31-f2ad-40e1-806b-ac6283c25108 for instance de41ca65-2b6d-4244-94d4-76d9cdf3bf12 on hv-cinder-84315 May 24 15:42:03.305381 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-320f906f-8e3f-49fc-9a59-9928e735184b req-3ca16169-535c-4d7b-909b-d2f3a8307767 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032557 May 24 15:42:03.305954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 279/513] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:03.501180 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-71f6885e-7814-4893-a93a-0e668961e6c8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:03.502182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-71f6885e-7814-4893-a93a-0e668961e6c8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:03.512996 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-71f6885e-7814-4893-a93a-0e668961e6c8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.513739 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-71f6885e-7814-4893-a93a-0e668961e6c8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.515011 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-71f6885e-7814-4893-a93a-0e668961e6c8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:03.515787 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-71f6885e-7814-4893-a93a-0e668961e6c8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:03.655348 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-71f6885e-7814-4893-a93a-0e668961e6c8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:03.664593 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-71f6885e-7814-4893-a93a-0e668961e6c8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.169847 May 24 15:42:03.665167 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 235/514] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:03 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:04.277276 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3e01d62e-f07d-4230-943a-d861bcde1e24 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:04.278424 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3e01d62e-f07d-4230-943a-d861bcde1e24 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:04.289001 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3e01d62e-f07d-4230-943a-d861bcde1e24 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:04.289812 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3e01d62e-f07d-4230-943a-d861bcde1e24 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:04.290941 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3e01d62e-f07d-4230-943a-d861bcde1e24 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:04.291681 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3e01d62e-f07d-4230-943a-d861bcde1e24 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:04.436816 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3e01d62e-f07d-4230-943a-d861bcde1e24 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:04.445229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3e01d62e-f07d-4230-943a-d861bcde1e24 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1318 microversion: 2.1 time: 0.175733 May 24 15:42:04.445789 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 280/515] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:04 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:04.684438 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-91ac9b1c-4f35-4a17-a9c8-19cb354abfa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:04.685008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-91ac9b1c-4f35-4a17-a9c8-19cb354abfa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:04.692751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-91ac9b1c-4f35-4a17-a9c8-19cb354abfa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:04.693198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-91ac9b1c-4f35-4a17-a9c8-19cb354abfa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:04.693957 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-91ac9b1c-4f35-4a17-a9c8-19cb354abfa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:04.694385 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-91ac9b1c-4f35-4a17-a9c8-19cb354abfa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:04.829594 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-91ac9b1c-4f35-4a17-a9c8-19cb354abfa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:04.839080 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-91ac9b1c-4f35-4a17-a9c8-19cb354abfa5 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.160152 May 24 15:42:04.839618 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 236/516] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:04 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:05.466165 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-082eb10f-a00a-475e-b499-96b7f664100b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:05.467167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-082eb10f-a00a-475e-b499-96b7f664100b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:05.475578 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082eb10f-a00a-475e-b499-96b7f664100b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.476017 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082eb10f-a00a-475e-b499-96b7f664100b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.476799 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082eb10f-a00a-475e-b499-96b7f664100b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.477220 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-082eb10f-a00a-475e-b499-96b7f664100b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.607878 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-082eb10f-a00a-475e-b499-96b7f664100b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:05.615628 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-082eb10f-a00a-475e-b499-96b7f664100b tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1318 microversion: 2.1 time: 0.155905 May 24 15:42:05.616444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 281/517] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:05 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:05.863622 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-69ce31c7-1d44-439f-b719-5e11363d8356 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:05.864371 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-69ce31c7-1d44-439f-b719-5e11363d8356 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:05.871261 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69ce31c7-1d44-439f-b719-5e11363d8356 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.871699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69ce31c7-1d44-439f-b719-5e11363d8356 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.872495 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69ce31c7-1d44-439f-b719-5e11363d8356 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:05.872892 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69ce31c7-1d44-439f-b719-5e11363d8356 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:05.888091 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:06.004295 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-69ce31c7-1d44-439f-b719-5e11363d8356 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:06.012411 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-69ce31c7-1d44-439f-b719-5e11363d8356 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.158547 May 24 15:42:06.013017 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 237/518] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:05 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:06.633238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6cfe4dcd-b780-4c22-b47e-d07b8f45b36e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:06.633855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6cfe4dcd-b780-4c22-b47e-d07b8f45b36e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:06.640208 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6cfe4dcd-b780-4c22-b47e-d07b8f45b36e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:06.640649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6cfe4dcd-b780-4c22-b47e-d07b8f45b36e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:06.641405 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6cfe4dcd-b780-4c22-b47e-d07b8f45b36e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:06.641827 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6cfe4dcd-b780-4c22-b47e-d07b8f45b36e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:06.855777 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6cfe4dcd-b780-4c22-b47e-d07b8f45b36e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:06.864144 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6cfe4dcd-b780-4c22-b47e-d07b8f45b36e tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1318 microversion: 2.1 time: 0.234694 May 24 15:42:06.864735 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 282/519] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:06 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:07.030297 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5580278a-44ff-43d0-a4a9-ff875a01f728 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:07.030896 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5580278a-44ff-43d0-a4a9-ff875a01f728 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:07.038416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5580278a-44ff-43d0-a4a9-ff875a01f728 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.038859 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5580278a-44ff-43d0-a4a9-ff875a01f728 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.039632 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5580278a-44ff-43d0-a4a9-ff875a01f728 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.040087 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5580278a-44ff-43d0-a4a9-ff875a01f728 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.185676 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5580278a-44ff-43d0-a4a9-ff875a01f728 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:07.194292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5580278a-44ff-43d0-a4a9-ff875a01f728 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.167991 May 24 15:42:07.194883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 238/520] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:07 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:07.646928 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:07.648736 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=6 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:07.653406 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-0ee8f39b-673d-436a-b20d-4909cea96427 req-7191f57b-6876-4884-ba19-bb86e4877f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de41ca65-2b6d-4244-94d4-76d9cdf3bf12", "name": "network-vif-plugged", "status": "completed", "tag": "ce97ee31-f2ad-40e1-806b-ac6283c25108"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:07.663088 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-0ee8f39b-673d-436a-b20d-4909cea96427 req-7191f57b-6876-4884-ba19-bb86e4877f2d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.663857 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-0ee8f39b-673d-436a-b20d-4909cea96427 req-7191f57b-6876-4884-ba19-bb86e4877f2d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.677333 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-0ee8f39b-673d-436a-b20d-4909cea96427 req-7191f57b-6876-4884-ba19-bb86e4877f2d service nova] Creating event network-vif-plugged:ce97ee31-f2ad-40e1-806b-ac6283c25108 for instance de41ca65-2b6d-4244-94d4-76d9cdf3bf12 on hv-cinder-84315 May 24 15:42:07.683525 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-0ee8f39b-673d-436a-b20d-4909cea96427 req-7191f57b-6876-4884-ba19-bb86e4877f2d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037581 May 24 15:42:07.684470 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 283/521] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:42:07.882657 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ad80323a-1084-4d4c-83c1-0bbd4f5c6135 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:07.883395 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ad80323a-1084-4d4c-83c1-0bbd4f5c6135 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:07.885275 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:07.891075 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ad80323a-1084-4d4c-83c1-0bbd4f5c6135 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.891521 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ad80323a-1084-4d4c-83c1-0bbd4f5c6135 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:07.892319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ad80323a-1084-4d4c-83c1-0bbd4f5c6135 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:07.892761 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ad80323a-1084-4d4c-83c1-0bbd4f5c6135 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.043185 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ad80323a-1084-4d4c-83c1-0bbd4f5c6135 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:08.054104 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ad80323a-1084-4d4c-83c1-0bbd4f5c6135 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1318 microversion: 2.1 time: 0.175637 May 24 15:42:08.054941 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 239/522] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:07 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:08.211611 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1030ff1d-1a63-4e94-967f-ec326674a940 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:08.212420 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1030ff1d-1a63-4e94-967f-ec326674a940 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:08.218975 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1030ff1d-1a63-4e94-967f-ec326674a940 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:08.219414 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1030ff1d-1a63-4e94-967f-ec326674a940 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.220272 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1030ff1d-1a63-4e94-967f-ec326674a940 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:08.220700 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1030ff1d-1a63-4e94-967f-ec326674a940 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:08.350196 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1030ff1d-1a63-4e94-967f-ec326674a940 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:08.358479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1030ff1d-1a63-4e94-967f-ec326674a940 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.151299 May 24 15:42:08.359023 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 284/523] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:08 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:09.072717 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6cc0c5da-b239-4d8b-ba11-cdf93070f665 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:09.073444 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6cc0c5da-b239-4d8b-ba11-cdf93070f665 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:09.082208 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6cc0c5da-b239-4d8b-ba11-cdf93070f665 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:09.082848 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6cc0c5da-b239-4d8b-ba11-cdf93070f665 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:09.083605 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6cc0c5da-b239-4d8b-ba11-cdf93070f665 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:09.084186 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6cc0c5da-b239-4d8b-ba11-cdf93070f665 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:09.223129 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6cc0c5da-b239-4d8b-ba11-cdf93070f665 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:09.231428 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6cc0c5da-b239-4d8b-ba11-cdf93070f665 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1318 microversion: 2.1 time: 0.163687 May 24 15:42:09.231999 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 240/524] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:09 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:09.381314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7912d138-82e4-49c4-bb50-2c851f591dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:09.381971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7912d138-82e4-49c4-bb50-2c851f591dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:09.389052 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7912d138-82e4-49c4-bb50-2c851f591dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:09.389508 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7912d138-82e4-49c4-bb50-2c851f591dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:09.390327 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7912d138-82e4-49c4-bb50-2c851f591dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:09.390794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7912d138-82e4-49c4-bb50-2c851f591dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:09.521533 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7912d138-82e4-49c4-bb50-2c851f591dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:09.529871 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7912d138-82e4-49c4-bb50-2c851f591dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.154885 May 24 15:42:09.530436 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 285/525] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:09 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:10.250755 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ccc663bf-5db4-4ce2-b719-51dfa696845c tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:10.251334 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ccc663bf-5db4-4ce2-b719-51dfa696845c tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:10.258490 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ccc663bf-5db4-4ce2-b719-51dfa696845c tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:10.258930 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ccc663bf-5db4-4ce2-b719-51dfa696845c tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:10.259687 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ccc663bf-5db4-4ce2-b719-51dfa696845c tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:10.260156 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ccc663bf-5db4-4ce2-b719-51dfa696845c tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:10.405751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ccc663bf-5db4-4ce2-b719-51dfa696845c tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:10.414798 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ccc663bf-5db4-4ce2-b719-51dfa696845c tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1507 microversion: 2.1 time: 0.167952 May 24 15:42:10.415332 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 241/526] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:10 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:10.431355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e6360940-764a-4514-bf98-d8f00c84d6de tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "443998db-ef58-4612-ad7e-834a62e3da69", "device": "/dev/sdb"}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:10.432965 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e6360940-764a-4514-bf98-d8f00c84d6de tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:10.442110 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e6360940-764a-4514-bf98-d8f00c84d6de tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:10.442947 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e6360940-764a-4514-bf98-d8f00c84d6de tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:10.444010 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e6360940-764a-4514-bf98-d8f00c84d6de tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:10.444646 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e6360940-764a-4514-bf98-d8f00c84d6de tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:10.547000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4d4f929d-8726-4a70-8af1-a2d1e1f90dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:10.547608 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4d4f929d-8726-4a70-8af1-a2d1e1f90dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:10.554004 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d4f929d-8726-4a70-8af1-a2d1e1f90dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:10.554454 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d4f929d-8726-4a70-8af1-a2d1e1f90dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:10.555209 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d4f929d-8726-4a70-8af1-a2d1e1f90dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:10.555635 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d4f929d-8726-4a70-8af1-a2d1e1f90dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:10.688448 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4d4f929d-8726-4a70-8af1-a2d1e1f90dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:10.697314 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4d4f929d-8726-4a70-8af1-a2d1e1f90dd4 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.154159 May 24 15:42:10.697878 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 242/527] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:10 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:42:10.772329 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e6360940-764a-4514-bf98-d8f00c84d6de tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "POST /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344716 May 24 15:42:10.772942 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 286/528] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:42:10 2022] POST /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:11.715442 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2207eaee-d396-44eb-9cd9-86d94b5e6339 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:11.716058 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2207eaee-d396-44eb-9cd9-86d94b5e6339 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:11.722521 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2207eaee-d396-44eb-9cd9-86d94b5e6339 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:11.722960 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2207eaee-d396-44eb-9cd9-86d94b5e6339 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:11.723739 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2207eaee-d396-44eb-9cd9-86d94b5e6339 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:11.724199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2207eaee-d396-44eb-9cd9-86d94b5e6339 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:11.869080 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2207eaee-d396-44eb-9cd9-86d94b5e6339 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:11.877158 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2207eaee-d396-44eb-9cd9-86d94b5e6339 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.166091 May 24 15:42:11.877709 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 243/529] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:11 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:12.898782 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d6b093ff-746f-4ea0-aab8-2c99eeb64cc9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:12.899471 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d6b093ff-746f-4ea0-aab8-2c99eeb64cc9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:12.906227 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6b093ff-746f-4ea0-aab8-2c99eeb64cc9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:12.906672 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6b093ff-746f-4ea0-aab8-2c99eeb64cc9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:12.907434 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6b093ff-746f-4ea0-aab8-2c99eeb64cc9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:12.907864 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d6b093ff-746f-4ea0-aab8-2c99eeb64cc9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:12.922826 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:13.039866 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d6b093ff-746f-4ea0-aab8-2c99eeb64cc9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:13.048171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d6b093ff-746f-4ea0-aab8-2c99eeb64cc9 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.155854 May 24 15:42:13.048736 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 287/530] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:12 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:14.068275 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-27602c52-9df9-4dbe-8af6-ccfc1e6911f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:14.069062 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-27602c52-9df9-4dbe-8af6-ccfc1e6911f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:14.077786 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27602c52-9df9-4dbe-8af6-ccfc1e6911f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:14.078370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27602c52-9df9-4dbe-8af6-ccfc1e6911f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:14.079471 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27602c52-9df9-4dbe-8af6-ccfc1e6911f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:14.080076 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27602c52-9df9-4dbe-8af6-ccfc1e6911f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:14.235048 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-27602c52-9df9-4dbe-8af6-ccfc1e6911f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:14.243651 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-27602c52-9df9-4dbe-8af6-ccfc1e6911f3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.181452 May 24 15:42:14.244226 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 244/531] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:14 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:15.265139 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-404d1794-e11d-4f3f-a923-ba76b23f4992 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:15.266139 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-404d1794-e11d-4f3f-a923-ba76b23f4992 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:15.277649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-404d1794-e11d-4f3f-a923-ba76b23f4992 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:15.278283 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-404d1794-e11d-4f3f-a923-ba76b23f4992 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:15.279523 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-404d1794-e11d-4f3f-a923-ba76b23f4992 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:15.280306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-404d1794-e11d-4f3f-a923-ba76b23f4992 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:15.442793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-404d1794-e11d-4f3f-a923-ba76b23f4992 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:15.451407 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-404d1794-e11d-4f3f-a923-ba76b23f4992 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.192766 May 24 15:42:15.451982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 288/532] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:15 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:16.474316 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-18950c4e-82b9-4162-9992-99e7ff0dd0f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:16.474909 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-18950c4e-82b9-4162-9992-99e7ff0dd0f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:16.477400 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=56 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:16.482982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-18950c4e-82b9-4162-9992-99e7ff0dd0f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:16.483420 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-18950c4e-82b9-4162-9992-99e7ff0dd0f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:16.484209 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-18950c4e-82b9-4162-9992-99e7ff0dd0f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:16.484630 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-18950c4e-82b9-4162-9992-99e7ff0dd0f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:16.624412 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-18950c4e-82b9-4162-9992-99e7ff0dd0f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:16.632795 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-18950c4e-82b9-4162-9992-99e7ff0dd0f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.162403 May 24 15:42:16.633368 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 245/533] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:16 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:17.650687 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-008f2618-133e-482b-b893-aecaf5577b1d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:17.651395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-008f2618-133e-482b-b893-aecaf5577b1d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:17.658431 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-008f2618-133e-482b-b893-aecaf5577b1d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:17.658898 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-008f2618-133e-482b-b893-aecaf5577b1d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:17.659625 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-008f2618-133e-482b-b893-aecaf5577b1d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:17.660060 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-008f2618-133e-482b-b893-aecaf5577b1d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:18.054883 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-008f2618-133e-482b-b893-aecaf5577b1d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:18.062947 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-008f2618-133e-482b-b893-aecaf5577b1d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.416193 May 24 15:42:18.063559 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 289/534] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:17 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:19.085175 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-37e329f6-b909-49df-b092-9bd005241334 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:19.086148 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-37e329f6-b909-49df-b092-9bd005241334 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:19.094977 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-37e329f6-b909-49df-b092-9bd005241334 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:19.095420 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-37e329f6-b909-49df-b092-9bd005241334 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:19.096214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-37e329f6-b909-49df-b092-9bd005241334 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:19.096636 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-37e329f6-b909-49df-b092-9bd005241334 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:19.231450 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-37e329f6-b909-49df-b092-9bd005241334 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:19.242694 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-37e329f6-b909-49df-b092-9bd005241334 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.163968 May 24 15:42:19.243253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 246/535] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:19 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:20.260853 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8c3e561c-08dd-46fa-9ce2-0b6d6ae49020 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:20.261455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8c3e561c-08dd-46fa-9ce2-0b6d6ae49020 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:20.268504 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c3e561c-08dd-46fa-9ce2-0b6d6ae49020 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:20.268949 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c3e561c-08dd-46fa-9ce2-0b6d6ae49020 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:20.269705 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c3e561c-08dd-46fa-9ce2-0b6d6ae49020 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:20.270478 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8c3e561c-08dd-46fa-9ce2-0b6d6ae49020 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:20.409442 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8c3e561c-08dd-46fa-9ce2-0b6d6ae49020 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:20.417877 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8c3e561c-08dd-46fa-9ce2-0b6d6ae49020 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.160978 May 24 15:42:20.418688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 290/536] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:20 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:21.435197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0acd1a5f-d9b6-4447-937c-eb82908d8350 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:21.435811 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0acd1a5f-d9b6-4447-937c-eb82908d8350 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:21.442767 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0acd1a5f-d9b6-4447-937c-eb82908d8350 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:21.443201 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0acd1a5f-d9b6-4447-937c-eb82908d8350 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:21.443950 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0acd1a5f-d9b6-4447-937c-eb82908d8350 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:21.444454 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0acd1a5f-d9b6-4447-937c-eb82908d8350 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:21.574786 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0acd1a5f-d9b6-4447-937c-eb82908d8350 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:21.582973 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0acd1a5f-d9b6-4447-937c-eb82908d8350 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1734 microversion: 2.1 time: 0.151864 May 24 15:42:21.583581 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 247/537] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:21 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:22.600338 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-48934b5e-8435-4acd-bfc5-59775dff15eb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:22.600956 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-48934b5e-8435-4acd-bfc5-59775dff15eb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:22.607635 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-48934b5e-8435-4acd-bfc5-59775dff15eb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.608113 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-48934b5e-8435-4acd-bfc5-59775dff15eb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.608876 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-48934b5e-8435-4acd-bfc5-59775dff15eb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.609305 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-48934b5e-8435-4acd-bfc5-59775dff15eb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-48934b5e-8435-4acd-bfc5-59775dff15eb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:22.759387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-48934b5e-8435-4acd-bfc5-59775dff15eb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1714 microversion: 2.1 time: 0.162865 May 24 15:42:22.759966 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 291/538] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:22 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:22.864424 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1e6e490f-8eb4-471e-a247-63a64b6799a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:22.864958 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1e6e490f-8eb4-471e-a247-63a64b6799a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:22.871860 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1e6e490f-8eb4-471e-a247-63a64b6799a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.872163 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1e6e490f-8eb4-471e-a247-63a64b6799a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.872913 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1e6e490f-8eb4-471e-a247-63a64b6799a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.873347 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1e6e490f-8eb4-471e-a247-63a64b6799a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.968562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-1e6e490f-8eb4-471e-a247-63a64b6799a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] HTTP exception thrown: Cannot 'detach_volume' instance 3f726278-c770-47b5-86db-c95db49ba80f while it is in vm_state rescued May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1e6e490f-8eb4-471e-a247-63a64b6799a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Request method failure captured: May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: DELETE /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments/054c5fd8-5054-42c5-bcb4-5818db05e074 HTTP/1.1 May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPvlT08falb-kbxErhnH4y_YxizG-iXi7Na5jtycP_ZDumNGA-LHP5Tl6lKn2dWP3vNAS8YgpJpxxPPoLUw_y5zCzNXpLx-D48XlgwdXZ_qVCv6JBhiW29zgII-w90Qp5k2SHhtWG5PB3Fp9pK6GeYy1i1bySozFoQa1X8Er2a4uxu8 May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: e280d545f6064b5c91289a77e2491511 May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:42:22.970197 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e280d545f6064b5c91289a77e2491511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e280d545f6064b5c91289a77e2491511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e280d545f6064b5c91289a77e2491511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e280d545f6064b5c91289a77e2491511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: e280d545f6064b5c91289a77e2491511 May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-ServerRescueNegativeTestJSON-2086104122-project May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 6d07884e92bc4cfe95d2fd99c40f25f0 May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086104122-project May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:42:22.971746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Cannot 'detach_volume' instance 3f726278-c770-47b5-86db-c95db49ba80f while it is in vm_state rescued May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'server_id': '3f726278-c770-47b5-86db-c95db49ba80f', 'id': '054c5fd8-5054-42c5-bcb4-5818db05e074'} May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3f726278-c770-47b5-86db-c95db49ba80f in vm_state rescued. Cannot detach_volume while the instance is in this state. May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:42:22.972607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3f726278-c770-47b5-86db-c95db49ba80f while it is in vm_state rescued May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3f726278-c770-47b5-86db-c95db49ba80f while it is in vm_state rescued May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:42:22.974064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1e6e490f-8eb4-471e-a247-63a64b6799a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Returning 409 to user: Cannot 'detach_volume' instance 3f726278-c770-47b5-86db-c95db49ba80f while it is in vm_state rescued {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:42:22.975367 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1e6e490f-8eb4-471e-a247-63a64b6799a6 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments/054c5fd8-5054-42c5-bcb4-5818db05e074" status: 409 len: 152 microversion: 2.1 time: 0.111282 May 24 15:42:22.975759 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 248/539] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:42:22 2022] DELETE /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments/054c5fd8-5054-42c5-bcb4-5818db05e074 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 15:42:22.980701 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-701a9e09-b615-4677-bbc0-0b79118eeb12 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:22.981307 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-701a9e09-b615-4677-bbc0-0b79118eeb12 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:22.988630 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-701a9e09-b615-4677-bbc0-0b79118eeb12 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.989079 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-701a9e09-b615-4677-bbc0-0b79118eeb12 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:22.989839 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-701a9e09-b615-4677-bbc0-0b79118eeb12 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:22.990269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-701a9e09-b615-4677-bbc0-0b79118eeb12 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:23.063118 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-701a9e09-b615-4677-bbc0-0b79118eeb12 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "POST /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/action" status: 202 len: 0 microversion: 2.1 time: 0.086138 May 24 15:42:23.063786 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 292/540] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:42:22 2022] POST /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 15:42:23.075397 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-60d305b0-6fdb-4a6e-ac3f-a1dc32964e00 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:23.075996 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-60d305b0-6fdb-4a6e-ac3f-a1dc32964e00 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:23.081995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-60d305b0-6fdb-4a6e-ac3f-a1dc32964e00 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:23.082402 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-60d305b0-6fdb-4a6e-ac3f-a1dc32964e00 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:23.083149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-60d305b0-6fdb-4a6e-ac3f-a1dc32964e00 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:23.083577 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-60d305b0-6fdb-4a6e-ac3f-a1dc32964e00 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:23.213271 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-60d305b0-6fdb-4a6e-ac3f-a1dc32964e00 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:23.226396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-60d305b0-6fdb-4a6e-ac3f-a1dc32964e00 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1722 microversion: 2.1 time: 0.155825 May 24 15:42:23.227165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 249/541] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:23 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:24.252009 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-52847081-b341-44a0-b5a1-2f6bd88d7522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:24.252761 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-52847081-b341-44a0-b5a1-2f6bd88d7522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:24.259843 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-52847081-b341-44a0-b5a1-2f6bd88d7522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:24.260306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-52847081-b341-44a0-b5a1-2f6bd88d7522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:24.261061 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-52847081-b341-44a0-b5a1-2f6bd88d7522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:24.261482 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-52847081-b341-44a0-b5a1-2f6bd88d7522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:24.401910 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-52847081-b341-44a0-b5a1-2f6bd88d7522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:24.412981 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-52847081-b341-44a0-b5a1-2f6bd88d7522 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1722 microversion: 2.1 time: 0.168473 May 24 15:42:24.413770 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 293/542] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:24 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:25.436237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d5fcc906-7c71-4dd8-b54d-49b628629738 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:25.436887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d5fcc906-7c71-4dd8-b54d-49b628629738 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:25.443790 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d5fcc906-7c71-4dd8-b54d-49b628629738 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:25.444264 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d5fcc906-7c71-4dd8-b54d-49b628629738 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:25.445047 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d5fcc906-7c71-4dd8-b54d-49b628629738 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:25.445482 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d5fcc906-7c71-4dd8-b54d-49b628629738 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:25.573711 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d5fcc906-7c71-4dd8-b54d-49b628629738 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:25.582311 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d5fcc906-7c71-4dd8-b54d-49b628629738 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1722 microversion: 2.1 time: 0.150126 May 24 15:42:25.582884 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 250/543] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:25 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:25.924845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-17ed35ca-e195-4eab-b148-9f28747c4897 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:25.925381 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-17ed35ca-e195-4eab-b148-9f28747c4897 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:25.932209 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-17ed35ca-e195-4eab-b148-9f28747c4897 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:25.932650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-17ed35ca-e195-4eab-b148-9f28747c4897 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:25.933407 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-17ed35ca-e195-4eab-b148-9f28747c4897 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:25.933824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-17ed35ca-e195-4eab-b148-9f28747c4897 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:25.965760 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-17ed35ca-e195-4eab-b148-9f28747c4897 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments/65b9ac42-09a2-4494-ad86-964e07db25dc" status: 200 len: 194 microversion: 2.20 time: 0.046552 May 24 15:42:25.966357 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 294/544] 10.222.0.55 () {60 vars in 1453 bytes} [Tue May 24 15:42:25 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments/65b9ac42-09a2-4494-ad86-964e07db25dc => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:42:26.030950 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f2164a1c-3789-4f8c-8bd4-c16e96343525 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:26.031440 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f2164a1c-3789-4f8c-8bd4-c16e96343525 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:26.037667 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f2164a1c-3789-4f8c-8bd4-c16e96343525 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:26.038111 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f2164a1c-3789-4f8c-8bd4-c16e96343525 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:26.038873 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f2164a1c-3789-4f8c-8bd4-c16e96343525 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:26.039300 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f2164a1c-3789-4f8c-8bd4-c16e96343525 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:26.120863 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-f2164a1c-3789-4f8c-8bd4-c16e96343525 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lazy-loading 'services' on Instance uuid ca2694ac-4a5e-4cfa-aaf8-877c8285148a {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:42:26.196619 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f2164a1c-3789-4f8c-8bd4-c16e96343525 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments/65b9ac42-09a2-4494-ad86-964e07db25dc" status: 202 len: 0 microversion: 2.20 time: 0.169417 May 24 15:42:26.197221 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 251/545] 10.222.0.55 () {60 vars in 1456 bytes} [Tue May 24 15:42:26 2022] DELETE /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments/65b9ac42-09a2-4494-ad86-964e07db25dc => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 15:42:26.205787 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c201c27e-6ebb-4df1-8c67-db297020960d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:26.207226 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c201c27e-6ebb-4df1-8c67-db297020960d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:26.213724 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c201c27e-6ebb-4df1-8c67-db297020960d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:26.214446 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c201c27e-6ebb-4df1-8c67-db297020960d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:26.215503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c201c27e-6ebb-4df1-8c67-db297020960d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:26.216020 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c201c27e-6ebb-4df1-8c67-db297020960d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:26.247224 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c201c27e-6ebb-4df1-8c67-db297020960d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045411 May 24 15:42:26.247874 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 295/546] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 24 15:42:26 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:42:26.605055 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5d012e14-1380-4e17-b3f1-9c905411d29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:26.606051 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5d012e14-1380-4e17-b3f1-9c905411d29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:26.617556 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5d012e14-1380-4e17-b3f1-9c905411d29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:26.618291 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5d012e14-1380-4e17-b3f1-9c905411d29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:26.619535 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5d012e14-1380-4e17-b3f1-9c905411d29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:26.620276 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5d012e14-1380-4e17-b3f1-9c905411d29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:26.771013 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5d012e14-1380-4e17-b3f1-9c905411d29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:26.783570 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5d012e14-1380-4e17-b3f1-9c905411d29e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1722 microversion: 2.1 time: 0.185481 May 24 15:42:26.784305 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 252/547] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:26 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:27.263934 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-22f26ff2-3e61-40a0-b12e-2eac9c2743fe tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:27.267647 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-22f26ff2-3e61-40a0-b12e-2eac9c2743fe tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:27.277577 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-22f26ff2-3e61-40a0-b12e-2eac9c2743fe tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:27.278020 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-22f26ff2-3e61-40a0-b12e-2eac9c2743fe tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:27.278805 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-22f26ff2-3e61-40a0-b12e-2eac9c2743fe tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:27.279240 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-22f26ff2-3e61-40a0-b12e-2eac9c2743fe tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:27.314988 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-22f26ff2-3e61-40a0-b12e-2eac9c2743fe tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058635 May 24 15:42:27.315582 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 296/548] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 24 15:42:27 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:42:27.803707 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-46479e11-1566-4b0e-8411-4a91aad3c1e0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:27.804389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-46479e11-1566-4b0e-8411-4a91aad3c1e0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:27.818724 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-46479e11-1566-4b0e-8411-4a91aad3c1e0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:27.819668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-46479e11-1566-4b0e-8411-4a91aad3c1e0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:27.820916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-46479e11-1566-4b0e-8411-4a91aad3c1e0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:27.821331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-46479e11-1566-4b0e-8411-4a91aad3c1e0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:27.839831 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:27.982468 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-46479e11-1566-4b0e-8411-4a91aad3c1e0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:27.993794 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-46479e11-1566-4b0e-8411-4a91aad3c1e0 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1722 microversion: 2.1 time: 0.195133 May 24 15:42:27.995025 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 253/549] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:27 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:28.331135 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4747f3a3-e966-4fef-99e1-dfac1a22a128 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:28.332168 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-4747f3a3-e966-4fef-99e1-dfac1a22a128 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:28.339304 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4747f3a3-e966-4fef-99e1-dfac1a22a128 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:28.339725 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4747f3a3-e966-4fef-99e1-dfac1a22a128 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:28.340642 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4747f3a3-e966-4fef-99e1-dfac1a22a128 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:28.341131 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4747f3a3-e966-4fef-99e1-dfac1a22a128 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:28.372846 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-4747f3a3-e966-4fef-99e1-dfac1a22a128 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047060 May 24 15:42:28.373412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 297/550] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 24 15:42:28 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:42:29.017635 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d9c53332-6b69-4234-b439-1c0127c5fc81 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:29.018293 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d9c53332-6b69-4234-b439-1c0127c5fc81 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:29.026514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d9c53332-6b69-4234-b439-1c0127c5fc81 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.027013 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d9c53332-6b69-4234-b439-1c0127c5fc81 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.027863 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d9c53332-6b69-4234-b439-1c0127c5fc81 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.028596 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d9c53332-6b69-4234-b439-1c0127c5fc81 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.172047 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d9c53332-6b69-4234-b439-1c0127c5fc81 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:29.181875 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d9c53332-6b69-4234-b439-1c0127c5fc81 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1722 microversion: 2.1 time: 0.170191 May 24 15:42:29.182447 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 254/551] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:29 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:29.384889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3cb9a5ed-8abc-4864-9d6a-1a77bb51a155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:29.385848 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3cb9a5ed-8abc-4864-9d6a-1a77bb51a155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:29.392851 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3cb9a5ed-8abc-4864-9d6a-1a77bb51a155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.393313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3cb9a5ed-8abc-4864-9d6a-1a77bb51a155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.394119 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3cb9a5ed-8abc-4864-9d6a-1a77bb51a155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.394582 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3cb9a5ed-8abc-4864-9d6a-1a77bb51a155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.424537 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3cb9a5ed-8abc-4864-9d6a-1a77bb51a155 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043736 May 24 15:42:29.425146 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 298/552] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 24 15:42:29 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:29.485671 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a95b8249-64d8-4045-a19f-bdc072664ac2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:29.486407 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a95b8249-64d8-4045-a19f-bdc072664ac2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:29.492692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a95b8249-64d8-4045-a19f-bdc072664ac2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.493124 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a95b8249-64d8-4045-a19f-bdc072664ac2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.493853 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a95b8249-64d8-4045-a19f-bdc072664ac2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.494273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a95b8249-64d8-4045-a19f-bdc072664ac2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.519182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a95b8249-64d8-4045-a19f-bdc072664ac2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:42:29.595667 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a95b8249-64d8-4045-a19f-bdc072664ac2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 204 len: 0 microversion: 2.20 time: 0.113621 May 24 15:42:29.596301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 255/553] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 24 15:42:29 2022] DELETE /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 15:42:29.604901 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-30a7c44e-6aac-41d0-9a7a-2cc262fa9c8f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:29.605599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-30a7c44e-6aac-41d0-9a7a-2cc262fa9c8f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:29.611700 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-30a7c44e-6aac-41d0-9a7a-2cc262fa9c8f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.612172 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-30a7c44e-6aac-41d0-9a7a-2cc262fa9c8f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.612919 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-30a7c44e-6aac-41d0-9a7a-2cc262fa9c8f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:29.613349 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-30a7c44e-6aac-41d0-9a7a-2cc262fa9c8f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:29.747144 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-30a7c44e-6aac-41d0-9a7a-2cc262fa9c8f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:29.763207 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-30a7c44e-6aac-41d0-9a7a-2cc262fa9c8f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:29.767479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-30a7c44e-6aac-41d0-9a7a-2cc262fa9c8f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:29.769129 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-30a7c44e-6aac-41d0-9a7a-2cc262fa9c8f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.168412 May 24 15:42:29.770033 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 299/554] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:29 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:42:30.200647 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2f834779-aa3b-4b7b-95ab-4f16b1ca4c10 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:30.201370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2f834779-aa3b-4b7b-95ab-4f16b1ca4c10 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:30.208597 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2f834779-aa3b-4b7b-95ab-4f16b1ca4c10 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.209036 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2f834779-aa3b-4b7b-95ab-4f16b1ca4c10 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:30.209799 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2f834779-aa3b-4b7b-95ab-4f16b1ca4c10 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.210475 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2f834779-aa3b-4b7b-95ab-4f16b1ca4c10 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:30.234012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2943ff5a-c11d-45cc-afbd-7700e2a1da87 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:30.234568 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2943ff5a-c11d-45cc-afbd-7700e2a1da87 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:30.240802 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2943ff5a-c11d-45cc-afbd-7700e2a1da87 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.241336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2943ff5a-c11d-45cc-afbd-7700e2a1da87 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:30.242164 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2943ff5a-c11d-45cc-afbd-7700e2a1da87 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.242650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2943ff5a-c11d-45cc-afbd-7700e2a1da87 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:30.356311 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2f834779-aa3b-4b7b-95ab-4f16b1ca4c10 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:30.365273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2f834779-aa3b-4b7b-95ab-4f16b1ca4c10 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1728 microversion: 2.1 time: 0.168961 May 24 15:42:30.365883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 256/555] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:30 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:30.381911 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-74f5a3c6-077d-4f32-b645-08172e9546d2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:30.382142 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-2943ff5a-c11d-45cc-afbd-7700e2a1da87 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lazy-loading 'services' on Instance uuid de41ca65-2b6d-4244-94d4-76d9cdf3bf12 {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:42:30.382396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-74f5a3c6-077d-4f32-b645-08172e9546d2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:30.388408 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-74f5a3c6-077d-4f32-b645-08172e9546d2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.388957 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-74f5a3c6-077d-4f32-b645-08172e9546d2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:30.389715 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-74f5a3c6-077d-4f32-b645-08172e9546d2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.390149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-74f5a3c6-077d-4f32-b645-08172e9546d2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:30.474632 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-74f5a3c6-077d-4f32-b645-08172e9546d2 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096429 May 24 15:42:30.475349 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 257/556] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 24 15:42:30 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:30.511128 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2943ff5a-c11d-45cc-afbd-7700e2a1da87 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "DELETE /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12/os-volume_attachments/443998db-ef58-4612-ad7e-834a62e3da69" status: 202 len: 0 microversion: 2.1 time: 0.280688 May 24 15:42:30.512006 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 300/557] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:42:30 2022] DELETE /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12/os-volume_attachments/443998db-ef58-4612-ad7e-834a62e3da69 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:42:30.794805 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0c2e8262-daea-4273-888a-0faec399090a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:30.795544 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0c2e8262-daea-4273-888a-0faec399090a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:30.803695 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c2e8262-daea-4273-888a-0faec399090a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.804486 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c2e8262-daea-4273-888a-0faec399090a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:30.805780 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c2e8262-daea-4273-888a-0faec399090a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:30.806214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c2e8262-daea-4273-888a-0faec399090a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:31.029907 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0c2e8262-daea-4273-888a-0faec399090a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:31.039090 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0c2e8262-daea-4273-888a-0faec399090a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:31.040681 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0c2e8262-daea-4273-888a-0faec399090a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:31.041848 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0c2e8262-daea-4273-888a-0faec399090a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.252489 May 24 15:42:31.042603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 258/558] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:30 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:31.497063 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-f3973f02-c0a2-4b27-b0b1-b20f901fc9eb req-9bb38902-d083-48aa-a406-df595848aa73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f726278-c770-47b5-86db-c95db49ba80f", "tag": "123b7faa-d212-4186-93a9-6e1d900b7f9c"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:31.500765 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=50 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:31.506940 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-f3973f02-c0a2-4b27-b0b1-b20f901fc9eb req-9bb38902-d083-48aa-a406-df595848aa73 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:31.507482 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-f3973f02-c0a2-4b27-b0b1-b20f901fc9eb req-9bb38902-d083-48aa-a406-df595848aa73 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:31.520224 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-f3973f02-c0a2-4b27-b0b1-b20f901fc9eb req-9bb38902-d083-48aa-a406-df595848aa73 service nova] Creating event network-changed:123b7faa-d212-4186-93a9-6e1d900b7f9c for instance 3f726278-c770-47b5-86db-c95db49ba80f on hv-cinder-84315 May 24 15:42:31.526941 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-f3973f02-c0a2-4b27-b0b1-b20f901fc9eb req-9bb38902-d083-48aa-a406-df595848aa73 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034463 May 24 15:42:31.527674 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 301/559] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:32.063906 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bf95b812-20de-4860-a627-78bfb656b352 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:32.065168 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bf95b812-20de-4860-a627-78bfb656b352 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:32.078632 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf95b812-20de-4860-a627-78bfb656b352 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.079453 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf95b812-20de-4860-a627-78bfb656b352 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.080403 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf95b812-20de-4860-a627-78bfb656b352 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.080990 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf95b812-20de-4860-a627-78bfb656b352 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.286115 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bf95b812-20de-4860-a627-78bfb656b352 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:32.309114 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bf95b812-20de-4860-a627-78bfb656b352 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:32.310945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bf95b812-20de-4860-a627-78bfb656b352 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:32.312489 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bf95b812-20de-4860-a627-78bfb656b352 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1721 microversion: 2.20 time: 0.253869 May 24 15:42:32.314013 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 259/560] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:32 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:32.694620 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e0f32a87-5aa7-4053-b647-d3b6a4931f39 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:32.695230 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e0f32a87-5aa7-4053-b647-d3b6a4931f39 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:32.701885 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e0f32a87-5aa7-4053-b647-d3b6a4931f39 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.702398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e0f32a87-5aa7-4053-b647-d3b6a4931f39 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.703238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e0f32a87-5aa7-4053-b647-d3b6a4931f39 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.703897 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e0f32a87-5aa7-4053-b647-d3b6a4931f39 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.731056 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e0f32a87-5aa7-4053-b647-d3b6a4931f39 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Going to try to terminate instance {{(pid=129340) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:42:32.747263 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:32.814472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e0f32a87-5aa7-4053-b647-d3b6a4931f39 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "DELETE /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 204 len: 0 microversion: 2.1 time: 0.124491 May 24 15:42:32.815153 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 302/561] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:42:32 2022] DELETE /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:42:32.823961 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-baa0df90-6f2a-4075-8adb-346d6681d8f2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:32.824634 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-baa0df90-6f2a-4075-8adb-346d6681d8f2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:32.838824 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-baa0df90-6f2a-4075-8adb-346d6681d8f2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.839240 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-baa0df90-6f2a-4075-8adb-346d6681d8f2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.840008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-baa0df90-6f2a-4075-8adb-346d6681d8f2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.840461 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-baa0df90-6f2a-4075-8adb-346d6681d8f2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.983440 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-1940ef38-6170-4a47-b1b0-2c71473afef2 req-fb6f2218-16cf-43a2-a536-01125fd8597b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2694ac-4a5e-4cfa-aaf8-877c8285148a", "name": "network-vif-deleted", "tag": "b4136280-42c5-46f1-8248-0dcb997d0277"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:32.984965 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-baa0df90-6f2a-4075-8adb-346d6681d8f2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:32.992662 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-1940ef38-6170-4a47-b1b0-2c71473afef2 req-fb6f2218-16cf-43a2-a536-01125fd8597b service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:32.992878 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-baa0df90-6f2a-4075-8adb-346d6681d8f2 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1513 microversion: 2.1 time: 0.173052 May 24 15:42:32.993092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-1940ef38-6170-4a47-b1b0-2c71473afef2 req-fb6f2218-16cf-43a2-a536-01125fd8597b service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:32.993458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 260/562] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:32 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:33.007211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-1940ef38-6170-4a47-b1b0-2c71473afef2 req-fb6f2218-16cf-43a2-a536-01125fd8597b service nova] Creating event network-vif-deleted:b4136280-42c5-46f1-8248-0dcb997d0277 for instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a on hv-cinder-84315 May 24 15:42:33.012786 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-1940ef38-6170-4a47-b1b0-2c71473afef2 req-fb6f2218-16cf-43a2-a536-01125fd8597b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 May 24 15:42:33.013058 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 303/563] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:33.332325 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-8134fe03-8c29-40d0-94e9-47cbd6747623 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:33.333002 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8134fe03-8c29-40d0-94e9-47cbd6747623 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:33.340222 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8134fe03-8c29-40d0-94e9-47cbd6747623 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:33.340893 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8134fe03-8c29-40d0-94e9-47cbd6747623 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:33.341874 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8134fe03-8c29-40d0-94e9-47cbd6747623 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:33.342494 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8134fe03-8c29-40d0-94e9-47cbd6747623 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:33.414909 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8134fe03-8c29-40d0-94e9-47cbd6747623 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:33.423661 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8134fe03-8c29-40d0-94e9-47cbd6747623 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:33.425182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8134fe03-8c29-40d0-94e9-47cbd6747623 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:33.426341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-8134fe03-8c29-40d0-94e9-47cbd6747623 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1653 microversion: 2.20 time: 0.098531 May 24 15:42:33.426897 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 261/564] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:33 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1653 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:33.545101 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-348839e3-3143-4cd0-9004-8164b192f88a req-0cdfc327-59a9-47f2-a3fd-a756a827dbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f726278-c770-47b5-86db-c95db49ba80f", "tag": "123b7faa-d212-4186-93a9-6e1d900b7f9c"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:33.554582 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-348839e3-3143-4cd0-9004-8164b192f88a req-0cdfc327-59a9-47f2-a3fd-a756a827dbd1 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:33.555130 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-348839e3-3143-4cd0-9004-8164b192f88a req-0cdfc327-59a9-47f2-a3fd-a756a827dbd1 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:33.568106 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-348839e3-3143-4cd0-9004-8164b192f88a req-0cdfc327-59a9-47f2-a3fd-a756a827dbd1 service nova] Creating event network-changed:123b7faa-d212-4186-93a9-6e1d900b7f9c for instance 3f726278-c770-47b5-86db-c95db49ba80f on hv-cinder-84315 May 24 15:42:33.573201 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-348839e3-3143-4cd0-9004-8164b192f88a req-0cdfc327-59a9-47f2-a3fd-a756a827dbd1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032188 May 24 15:42:33.574110 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 304/565] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:34.010350 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-aeb7ade0-4a68-40f4-8cd8-4b0a48e708fa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:34.011249 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-aeb7ade0-4a68-40f4-8cd8-4b0a48e708fa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:34.018085 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aeb7ade0-4a68-40f4-8cd8-4b0a48e708fa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:34.018683 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aeb7ade0-4a68-40f4-8cd8-4b0a48e708fa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:34.019884 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aeb7ade0-4a68-40f4-8cd8-4b0a48e708fa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:34.020473 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aeb7ade0-4a68-40f4-8cd8-4b0a48e708fa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:34.164602 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-aeb7ade0-4a68-40f4-8cd8-4b0a48e708fa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:34.172843 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-aeb7ade0-4a68-40f4-8cd8-4b0a48e708fa tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1513 microversion: 2.1 time: 0.166292 May 24 15:42:34.173416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 262/566] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:34 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:34.445449 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b46be6b5-bef7-463d-b9d2-6c757ab65e48 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:34.446150 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b46be6b5-bef7-463d-b9d2-6c757ab65e48 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:34.453305 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b46be6b5-bef7-463d-b9d2-6c757ab65e48 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:34.453711 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b46be6b5-bef7-463d-b9d2-6c757ab65e48 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:34.454585 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b46be6b5-bef7-463d-b9d2-6c757ab65e48 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:34.455062 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b46be6b5-bef7-463d-b9d2-6c757ab65e48 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:34.520058 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b46be6b5-bef7-463d-b9d2-6c757ab65e48 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:34.533017 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b46be6b5-bef7-463d-b9d2-6c757ab65e48 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:34.534592 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b46be6b5-bef7-463d-b9d2-6c757ab65e48 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:34.535886 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b46be6b5-bef7-463d-b9d2-6c757ab65e48 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 200 len: 1365 microversion: 2.20 time: 0.094844 May 24 15:42:34.536475 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 305/567] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:34 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:35.191172 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d6a410d2-ce2d-48c1-b5f2-d09f87fe6594 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:35.192660 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d6a410d2-ce2d-48c1-b5f2-d09f87fe6594 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:35.205751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d6a410d2-ce2d-48c1-b5f2-d09f87fe6594 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:35.211085 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d6a410d2-ce2d-48c1-b5f2-d09f87fe6594 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:35.213051 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d6a410d2-ce2d-48c1-b5f2-d09f87fe6594 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:35.214882 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d6a410d2-ce2d-48c1-b5f2-d09f87fe6594 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:35.434275 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d6a410d2-ce2d-48c1-b5f2-d09f87fe6594 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c940eba35194b8db4af6eaf2df8b135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769f37bc94e24c3482bb039c5a6e7291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:35.442395 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d6a410d2-ce2d-48c1-b5f2-d09f87fe6594 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 200 len: 1513 microversion: 2.1 time: 0.256125 May 24 15:42:35.442962 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 263/568] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:35 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:42:35.554848 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-aec24884-adbd-4b3b-97cd-24b08022455b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:35.555489 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-aec24884-adbd-4b3b-97cd-24b08022455b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:35.563494 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aec24884-adbd-4b3b-97cd-24b08022455b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:35.564269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aec24884-adbd-4b3b-97cd-24b08022455b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:35.565306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aec24884-adbd-4b3b-97cd-24b08022455b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:35.565917 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-aec24884-adbd-4b3b-97cd-24b08022455b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:35.589261 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-cb1e7871-b1db-4602-b22a-a944f8a0a0d5 req-9e1c1975-8737-4f4c-acca-6dd28f4d739b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de41ca65-2b6d-4244-94d4-76d9cdf3bf12", "name": "network-vif-deleted", "tag": "ce97ee31-f2ad-40e1-806b-ac6283c25108"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:35.592291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-aec24884-adbd-4b3b-97cd-24b08022455b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] HTTP exception thrown: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-aec24884-adbd-4b3b-97cd-24b08022455b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Request method failure captured: May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a HTTP/1.1 May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPvlMf_TuVuU3ml656y9qWN5PZ9OXLyRaJg35cJvYg2U9lsF-flvXfpzIWv_yVoYIo6EWdRP18y3gbsOYbc7RhH_gFy-GaYPWlCi8CZeVOl7E96PniY4k2XV5SOquOoB-Ca3KwQFpGIx5_Lh9m57fab7E7AYq_3oJq1e_Fy_A-VjPRg May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:42:35.594342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 9bb20bf4c31d44ac9dd9ef0db9a2a63a May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:42:35.597028 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'ca2694ac-4a5e-4cfa-aaf8-877c8285148a'} May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:42:35.597971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:42:35.599402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:42:35.601626 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-aec24884-adbd-4b3b-97cd-24b08022455b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Returning 404 to user: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:42:35.601626 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-aec24884-adbd-4b3b-97cd-24b08022455b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 404 len: 111 microversion: 2.20 time: 0.045647 May 24 15:42:35.602910 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 306/569] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:35 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 15:42:35.605226 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-cb1e7871-b1db-4602-b22a-a944f8a0a0d5 req-9e1c1975-8737-4f4c-acca-6dd28f4d739b service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:35.605764 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-cb1e7871-b1db-4602-b22a-a944f8a0a0d5 req-9e1c1975-8737-4f4c-acca-6dd28f4d739b service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:35.607806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-86b72eaa-b784-4df3-a943-2054a2e910b8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '.version_select at 0x7fb1d4912550>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:35.619879 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-cb1e7871-b1db-4602-b22a-a944f8a0a0d5 req-9e1c1975-8737-4f4c-acca-6dd28f4d739b service nova] Creating event network-vif-deleted:ce97ee31-f2ad-40e1-806b-ac6283c25108 for instance de41ca65-2b6d-4244-94d4-76d9cdf3bf12 on hv-cinder-84315 May 24 15:42:35.627958 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-cb1e7871-b1db-4602-b22a-a944f8a0a0d5 req-9e1c1975-8737-4f4c-acca-6dd28f4d739b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042569 May 24 15:42:35.629193 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 264/570] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:42:35.630675 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-86b72eaa-b784-4df3-a943-2054a2e910b8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-255421339" status: 204 len: 0 microversion: 2.20 time: 0.026459 May 24 15:42:35.631317 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 307/571] 10.222.0.55 () {60 vars in 1258 bytes} [Tue May 24 15:42:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-255421339 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 15:42:36.314892 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e91d3e64-d451-40ba-9bdf-e527dc4a7a8d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Action: 'create', calling method: .version_select at 0x7fb1d503d4c0>, body: {"keypair": {"name": "tempest-keypair-131312774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVdzlDjgxOyaqGbkJAf4pgRMSP/EyaVhhxog40YH+RmB0PoU4lUZYk6Z+8+TQRPzq0f26sw9SibLQaOI41pDKFyIoEtBdiRc8ngNHtbZS2UUj9wJ80MJ599SjxdnypyDA=="}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:36.334007 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-e91d3e64-d451-40ba-9bdf-e527dc4a7a8d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Getting quotas for project fd0613f4cbb3461a982738c683c3ab03. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:42:36.337980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-e91d3e64-d451-40ba-9bdf-e527dc4a7a8d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Getting quotas for user 9bb20bf4c31d44ac9dd9ef0db9a2a63a and project fd0613f4cbb3461a982738c683c3ab03. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:42:36.378691 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e91d3e64-d451-40ba-9bdf-e527dc4a7a8d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.069947 May 24 15:42:36.379339 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 265/572] 10.222.0.55 () {62 vars in 1199 bytes} [Tue May 24 15:42:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 24 15:42:36.460306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c9647c6c-bd24-44ed-a9e0-97d31f350ee0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:36.461176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c9647c6c-bd24-44ed-a9e0-97d31f350ee0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] [instance: de41ca65-2b6d-4244-94d4-76d9cdf3bf12] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:36.470708 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c9647c6c-bd24-44ed-a9e0-97d31f350ee0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:36.471397 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c9647c6c-bd24-44ed-a9e0-97d31f350ee0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:36.472502 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c9647c6c-bd24-44ed-a9e0-97d31f350ee0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:36.473081 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c9647c6c-bd24-44ed-a9e0-97d31f350ee0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:36.495331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-c9647c6c-bd24-44ed-a9e0-97d31f350ee0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] HTTP exception thrown: Instance de41ca65-2b6d-4244-94d4-76d9cdf3bf12 could not be found. May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c9647c6c-bd24-44ed-a9e0-97d31f350ee0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Request method failure captured: May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 HTTP/1.1 May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPxoExmWhxvGXiP-85xoSR_lPfrdkxzdeb-313m1QfsnlNTslP6ZX3LxVlgUQgdt3XvsAR_1sRjOXvqSXYSTxdZDJNVWzoXfpH81B_ahdHSFejfdc9Cwb34dDNlN51ILsez0HpXYVtk9yYqcjiHGsT7UVOKNkVlmYY7eE1VeRXjTXjg May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 769f37bc94e24c3482bb039c5a6e7291 May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1963881534 May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:42:36.496889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/769f37bc94e24c3482bb039c5a6e7291"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_769f37bc94e24c3482bb039c5a6e7291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/769f37bc94e24c3482bb039c5a6e7291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/769f37bc94e24c3482bb039c5a6e7291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-VolumesSnapshotTestJSON-1963881534 May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 769f37bc94e24c3482bb039c5a6e7291 May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1963881534 May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-VolumesSnapshotTestJSON-1963881534-project May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 8c940eba35194b8db4af6eaf2df8b135 May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-VolumesSnapshotTestJSON-1963881534-project May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance de41ca65-2b6d-4244-94d4-76d9cdf3bf12 could not be found. May 24 15:42:36.498466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'de41ca65-2b6d-4244-94d4-76d9cdf3bf12'} May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de41ca65-2b6d-4244-94d4-76d9cdf3bf12 could not be found. May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:42:36.499458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de41ca65-2b6d-4244-94d4-76d9cdf3bf12 could not be found. May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de41ca65-2b6d-4244-94d4-76d9cdf3bf12 could not be found. May 24 15:42:36.501444 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:42:36.502626 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c9647c6c-bd24-44ed-a9e0-97d31f350ee0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] Returning 404 to user: Instance de41ca65-2b6d-4244-94d4-76d9cdf3bf12 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:42:36.502626 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c9647c6c-bd24-44ed-a9e0-97d31f350ee0 tempest-VolumesSnapshotTestJSON-1963881534 tempest-VolumesSnapshotTestJSON-1963881534-project] 10.222.0.55 "GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12" status: 404 len: 111 microversion: 2.1 time: 0.042589 May 24 15:42:36.502626 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 308/573] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:42:36 2022] GET /compute/v2.1/servers/de41ca65-2b6d-4244-94d4-76d9cdf3bf12 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:42:38.024432 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-828486760", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "062393c0-66b9-4ecb-bb43-dbb81b8673fe"}], "security_groups": [{"name": "tempest-securitygroup--366787503"}], "key_name": "tempest-keypair-131312774", "user_data": "}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:38.129593 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] validate_networks() for [('062393c0-66b9-4ecb-bb43-dbb81b8673fe', None, None, None, None, None)] {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:42:38.517772 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:42:38.518185 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:42:38.518643 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:42:38.519042 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:42:38.519892 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:42:38.529370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:38.529824 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:38.530615 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:38.531050 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:38.553670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Getting quotas for project fd0613f4cbb3461a982738c683c3ab03. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:42:38.558118 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Getting quotas for user 9bb20bf4c31d44ac9dd9ef0db9a2a63a and project fd0613f4cbb3461a982738c683c3ab03. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:42:38.570226 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:42:38.572607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:42:38.622220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-22309f73-f589-464c-b69b-80bcaf3b5d6d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.603292 May 24 15:42:38.622863 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 266/574] 10.222.0.55 () {62 vars in 1187 bytes} [Tue May 24 15:42:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 15:42:38.632962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c749528d-7693-4a57-954a-b68f7f784ac0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:38.633724 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c749528d-7693-4a57-954a-b68f7f784ac0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:38.687431 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c749528d-7693-4a57-954a-b68f7f784ac0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:38.697034 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c749528d-7693-4a57-954a-b68f7f784ac0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:38.698574 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c749528d-7693-4a57-954a-b68f7f784ac0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:38.700638 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c749528d-7693-4a57-954a-b68f7f784ac0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1280 microversion: 2.20 time: 0.071259 May 24 15:42:38.701538 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 309/575] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:38 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:39.718966 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0217ffbc-fb76-4128-8466-37c032467f99 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:39.719611 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0217ffbc-fb76-4128-8466-37c032467f99 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:39.726777 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0217ffbc-fb76-4128-8466-37c032467f99 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:39.727214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0217ffbc-fb76-4128-8466-37c032467f99 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:39.727960 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0217ffbc-fb76-4128-8466-37c032467f99 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:39.728415 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0217ffbc-fb76-4128-8466-37c032467f99 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:39.795608 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0217ffbc-fb76-4128-8466-37c032467f99 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:39.803984 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0217ffbc-fb76-4128-8466-37c032467f99 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:39.805485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0217ffbc-fb76-4128-8466-37c032467f99 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:39.806593 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0217ffbc-fb76-4128-8466-37c032467f99 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1284 microversion: 2.20 time: 0.092185 May 24 15:42:39.807151 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 267/576] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:39 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:40.830608 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-efee810d-fa2b-4ee7-ac16-bce8d4a02052 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:40.831589 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-efee810d-fa2b-4ee7-ac16-bce8d4a02052 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:40.842823 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-efee810d-fa2b-4ee7-ac16-bce8d4a02052 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:40.843561 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-efee810d-fa2b-4ee7-ac16-bce8d4a02052 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:40.844873 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-efee810d-fa2b-4ee7-ac16-bce8d4a02052 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:40.845301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-efee810d-fa2b-4ee7-ac16-bce8d4a02052 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:40.909831 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-efee810d-fa2b-4ee7-ac16-bce8d4a02052 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:40.917957 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-efee810d-fa2b-4ee7-ac16-bce8d4a02052 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:40.919454 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-efee810d-fa2b-4ee7-ac16-bce8d4a02052 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:40.920571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-efee810d-fa2b-4ee7-ac16-bce8d4a02052 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1284 microversion: 2.20 time: 0.097984 May 24 15:42:40.921110 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 310/577] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:40 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:41.939262 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d2dbdd19-1c21-469e-a3ff-be9df10ec1b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:41.939903 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d2dbdd19-1c21-469e-a3ff-be9df10ec1b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:41.946600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d2dbdd19-1c21-469e-a3ff-be9df10ec1b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:41.947041 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d2dbdd19-1c21-469e-a3ff-be9df10ec1b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:41.947796 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d2dbdd19-1c21-469e-a3ff-be9df10ec1b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:41.948322 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d2dbdd19-1c21-469e-a3ff-be9df10ec1b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:42.043907 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d2dbdd19-1c21-469e-a3ff-be9df10ec1b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:42.052409 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d2dbdd19-1c21-469e-a3ff-be9df10ec1b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:42.053874 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d2dbdd19-1c21-469e-a3ff-be9df10ec1b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:42.054985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d2dbdd19-1c21-469e-a3ff-be9df10ec1b3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1338 microversion: 2.20 time: 0.120055 May 24 15:42:42.055553 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 268/578] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:41 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1338 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:43.073428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-68c12b74-f922-4ec4-ac4f-de3ed0cd63eb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:43.073982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-68c12b74-f922-4ec4-ac4f-de3ed0cd63eb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:43.082279 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68c12b74-f922-4ec4-ac4f-de3ed0cd63eb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:43.082926 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68c12b74-f922-4ec4-ac4f-de3ed0cd63eb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:43.083672 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68c12b74-f922-4ec4-ac4f-de3ed0cd63eb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:43.084302 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68c12b74-f922-4ec4-ac4f-de3ed0cd63eb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:43.108615 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-f9f782d3-d45b-4816-a5ab-05d14d510948 req-1c748b78-6e92-4e19-88fb-acf20d6f3c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a52505-bbe8-48c0-ba6f-ec99a6980285", "tag": "f0b68296-7928-4ede-98e0-8adf6abeff09"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:43.121032 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-f9f782d3-d45b-4816-a5ab-05d14d510948 req-1c748b78-6e92-4e19-88fb-acf20d6f3c3f service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:43.121473 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-f9f782d3-d45b-4816-a5ab-05d14d510948 req-1c748b78-6e92-4e19-88fb-acf20d6f3c3f service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:43.134123 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-f9f782d3-d45b-4816-a5ab-05d14d510948 req-1c748b78-6e92-4e19-88fb-acf20d6f3c3f service nova] Creating event network-changed:f0b68296-7928-4ede-98e0-8adf6abeff09 for instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 on hv-cinder-84315 May 24 15:42:43.144584 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-f9f782d3-d45b-4816-a5ab-05d14d510948 req-1c748b78-6e92-4e19-88fb-acf20d6f3c3f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040412 May 24 15:42:43.146085 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 269/579] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:43.270489 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-68c12b74-f922-4ec4-ac4f-de3ed0cd63eb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:43.278755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-68c12b74-f922-4ec4-ac4f-de3ed0cd63eb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:43.280258 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-68c12b74-f922-4ec4-ac4f-de3ed0cd63eb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:43.281488 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-68c12b74-f922-4ec4-ac4f-de3ed0cd63eb tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1405 microversion: 2.20 time: 0.212013 May 24 15:42:43.282106 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 311/580] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:43 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:44.304368 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5621d283-8d59-4699-987c-ffe142827a4e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:44.305556 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5621d283-8d59-4699-987c-ffe142827a4e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:44.315563 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5621d283-8d59-4699-987c-ffe142827a4e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:44.316005 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5621d283-8d59-4699-987c-ffe142827a4e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:44.316800 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5621d283-8d59-4699-987c-ffe142827a4e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:44.317233 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5621d283-8d59-4699-987c-ffe142827a4e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:44.449830 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5621d283-8d59-4699-987c-ffe142827a4e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:44.462665 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5621d283-8d59-4699-987c-ffe142827a4e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:44.465029 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5621d283-8d59-4699-987c-ffe142827a4e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:44.466698 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5621d283-8d59-4699-987c-ffe142827a4e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1405 microversion: 2.20 time: 0.169401 May 24 15:42:44.467527 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 270/581] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:44 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:45.486356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b010d541-9531-4c56-a8b3-c74a9635b8d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:45.486994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b010d541-9531-4c56-a8b3-c74a9635b8d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:45.493847 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b010d541-9531-4c56-a8b3-c74a9635b8d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:45.494286 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b010d541-9531-4c56-a8b3-c74a9635b8d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:45.495037 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b010d541-9531-4c56-a8b3-c74a9635b8d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:45.495458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b010d541-9531-4c56-a8b3-c74a9635b8d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:45.625006 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b010d541-9531-4c56-a8b3-c74a9635b8d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:45.633127 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b010d541-9531-4c56-a8b3-c74a9635b8d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:45.634603 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b010d541-9531-4c56-a8b3-c74a9635b8d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:45.635699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b010d541-9531-4c56-a8b3-c74a9635b8d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1405 microversion: 2.20 time: 0.153843 May 24 15:42:45.636625 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 312/582] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:45 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:46.658346 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-74f686fa-28fc-4818-ada9-2d9fc5bae25a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:46.658962 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-74f686fa-28fc-4818-ada9-2d9fc5bae25a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:46.661446 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:46.667103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-74f686fa-28fc-4818-ada9-2d9fc5bae25a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:46.667573 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-74f686fa-28fc-4818-ada9-2d9fc5bae25a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:46.668343 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-74f686fa-28fc-4818-ada9-2d9fc5bae25a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:46.668764 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-74f686fa-28fc-4818-ada9-2d9fc5bae25a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:46.804319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-74f686fa-28fc-4818-ada9-2d9fc5bae25a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:46.806585 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:46.813701 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-74f686fa-28fc-4818-ada9-2d9fc5bae25a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:46.815184 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-74f686fa-28fc-4818-ada9-2d9fc5bae25a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:46.816318 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-74f686fa-28fc-4818-ada9-2d9fc5bae25a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1405 microversion: 2.20 time: 0.163858 May 24 15:42:46.816910 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 271/583] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:46 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:47.838643 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-062a71f3-73c0-4a97-b381-49e6c1ca7643 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:47.839646 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-062a71f3-73c0-4a97-b381-49e6c1ca7643 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:47.850979 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-062a71f3-73c0-4a97-b381-49e6c1ca7643 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:47.851611 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-062a71f3-73c0-4a97-b381-49e6c1ca7643 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:47.852911 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-062a71f3-73c0-4a97-b381-49e6c1ca7643 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:47.853624 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-062a71f3-73c0-4a97-b381-49e6c1ca7643 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:47.988912 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-062a71f3-73c0-4a97-b381-49e6c1ca7643 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:47.997541 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-062a71f3-73c0-4a97-b381-49e6c1ca7643 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:47.999017 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-062a71f3-73c0-4a97-b381-49e6c1ca7643 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:48.000148 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-062a71f3-73c0-4a97-b381-49e6c1ca7643 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1405 microversion: 2.20 time: 0.168182 May 24 15:42:48.000786 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 313/584] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:47 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:49.020014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e5ea6d80-777d-47ec-9a9c-5e8c3119f794 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:49.020682 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e5ea6d80-777d-47ec-9a9c-5e8c3119f794 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:49.023953 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:49.024671 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=10 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:49.031472 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e5ea6d80-777d-47ec-9a9c-5e8c3119f794 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:49.031925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e5ea6d80-777d-47ec-9a9c-5e8c3119f794 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:49.032742 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e5ea6d80-777d-47ec-9a9c-5e8c3119f794 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:49.033165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e5ea6d80-777d-47ec-9a9c-5e8c3119f794 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:49.173528 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e5ea6d80-777d-47ec-9a9c-5e8c3119f794 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:49.183195 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e5ea6d80-777d-47ec-9a9c-5e8c3119f794 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:49.184635 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e5ea6d80-777d-47ec-9a9c-5e8c3119f794 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:49.185912 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e5ea6d80-777d-47ec-9a9c-5e8c3119f794 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1405 microversion: 2.20 time: 0.171615 May 24 15:42:49.186480 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 272/585] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:49 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:49.803739 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-47a97f53-bbce-4a0a-ae5f-15864a424a43 req-69eae1f7-1e1d-41f7-8460-3db1594c173c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a52505-bbe8-48c0-ba6f-ec99a6980285", "name": "network-vif-plugged", "status": "completed", "tag": "f0b68296-7928-4ede-98e0-8adf6abeff09"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:49.807395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:42:49.815017 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-47a97f53-bbce-4a0a-ae5f-15864a424a43 req-69eae1f7-1e1d-41f7-8460-3db1594c173c service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:49.815477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-47a97f53-bbce-4a0a-ae5f-15864a424a43 req-69eae1f7-1e1d-41f7-8460-3db1594c173c service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:49.826696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-47a97f53-bbce-4a0a-ae5f-15864a424a43 req-69eae1f7-1e1d-41f7-8460-3db1594c173c service nova] Creating event network-vif-plugged:f0b68296-7928-4ede-98e0-8adf6abeff09 for instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 on hv-cinder-84315 May 24 15:42:49.831719 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-47a97f53-bbce-4a0a-ae5f-15864a424a43 req-69eae1f7-1e1d-41f7-8460-3db1594c173c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031640 May 24 15:42:49.832361 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 314/586] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:42:50.206543 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-8202441a-15ac-4828-8bed-11f9fa895463 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:50.207124 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8202441a-15ac-4828-8bed-11f9fa895463 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:50.213799 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8202441a-15ac-4828-8bed-11f9fa895463 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:50.214244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8202441a-15ac-4828-8bed-11f9fa895463 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:50.214989 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8202441a-15ac-4828-8bed-11f9fa895463 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:50.215412 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8202441a-15ac-4828-8bed-11f9fa895463 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:50.344865 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8202441a-15ac-4828-8bed-11f9fa895463 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:50.352894 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8202441a-15ac-4828-8bed-11f9fa895463 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:50.354373 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8202441a-15ac-4828-8bed-11f9fa895463 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:50.355467 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-8202441a-15ac-4828-8bed-11f9fa895463 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1405 microversion: 2.20 time: 0.153672 May 24 15:42:50.356004 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 273/587] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:50 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:51.381434 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-09a698e2-0bae-4466-9684-80cfb8046c6a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:51.382111 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-09a698e2-0bae-4466-9684-80cfb8046c6a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:51.388533 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-09a698e2-0bae-4466-9684-80cfb8046c6a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:51.388987 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-09a698e2-0bae-4466-9684-80cfb8046c6a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:51.389748 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-09a698e2-0bae-4466-9684-80cfb8046c6a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:51.390201 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-09a698e2-0bae-4466-9684-80cfb8046c6a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:51.527506 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-09a698e2-0bae-4466-9684-80cfb8046c6a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:51.539608 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-09a698e2-0bae-4466-9684-80cfb8046c6a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:51.542015 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-09a698e2-0bae-4466-9684-80cfb8046c6a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:42:51.543735 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-09a698e2-0bae-4466-9684-80cfb8046c6a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1596 microversion: 2.20 time: 0.167006 May 24 15:42:51.544538 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 315/588] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:42:51 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1596 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:42:51.562070 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6f22b3ed-9dd2-4a97-b859-941977384419 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:42:51.562579 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6f22b3ed-9dd2-4a97-b859-941977384419 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:42:51.569169 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6f22b3ed-9dd2-4a97-b859-941977384419 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:51.569613 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6f22b3ed-9dd2-4a97-b859-941977384419 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:51.570376 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6f22b3ed-9dd2-4a97-b859-941977384419 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:51.570805 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6f22b3ed-9dd2-4a97-b859-941977384419 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:51.650396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6f22b3ed-9dd2-4a97-b859-941977384419 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092115 May 24 15:42:51.650993 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 274/589] 10.222.0.55 () {60 vars in 1315 bytes} [Tue May 24 15:42:51 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:42:52.824309 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-91534807-ef70-424a-99da-3935ba0eee17 req-049bfe08-0636-488c-84a9-fe8967dc5067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a52505-bbe8-48c0-ba6f-ec99a6980285", "tag": "f0b68296-7928-4ede-98e0-8adf6abeff09"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:42:52.834232 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-91534807-ef70-424a-99da-3935ba0eee17 req-049bfe08-0636-488c-84a9-fe8967dc5067 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:42:52.834675 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-91534807-ef70-424a-99da-3935ba0eee17 req-049bfe08-0636-488c-84a9-fe8967dc5067 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:42:52.846092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-91534807-ef70-424a-99da-3935ba0eee17 req-049bfe08-0636-488c-84a9-fe8967dc5067 service nova] Creating event network-changed:f0b68296-7928-4ede-98e0-8adf6abeff09 for instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 on hv-cinder-84315 May 24 15:42:52.851197 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-91534807-ef70-424a-99da-3935ba0eee17 req-049bfe08-0636-488c-84a9-fe8967dc5067 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031296 May 24 15:42:52.852109 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 316/590] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:03.820659 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-da43cd80-8b8a-43e1-beb3-d95ddfe83797 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:03.821823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-da43cd80-8b8a-43e1-beb3-d95ddfe83797 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:03.829144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=7 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:03.830456 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=17 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:03.833046 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-da43cd80-8b8a-43e1-beb3-d95ddfe83797 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:03.834343 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-da43cd80-8b8a-43e1-beb3-d95ddfe83797 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:03.835342 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-da43cd80-8b8a-43e1-beb3-d95ddfe83797 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:03.835952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-da43cd80-8b8a-43e1-beb3-d95ddfe83797 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:04.138616 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-da43cd80-8b8a-43e1-beb3-d95ddfe83797 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'services' on Instance uuid 3f726278-c770-47b5-86db-c95db49ba80f {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:04.242630 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-da43cd80-8b8a-43e1-beb3-d95ddfe83797 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments/054c5fd8-5054-42c5-bcb4-5818db05e074" status: 202 len: 0 microversion: 2.1 time: 0.424546 May 24 15:43:04.243813 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 275/591] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:43:03 2022] DELETE /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments/054c5fd8-5054-42c5-bcb4-5818db05e074 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:43:04.253334 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d8f165a0-3fe8-4630-8a40-722c73b55994 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:04.255082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d8f165a0-3fe8-4630-8a40-722c73b55994 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:04.262047 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:04.264329 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:04.266985 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d8f165a0-3fe8-4630-8a40-722c73b55994 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:04.268183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d8f165a0-3fe8-4630-8a40-722c73b55994 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:04.271987 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d8f165a0-3fe8-4630-8a40-722c73b55994 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:04.272975 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d8f165a0-3fe8-4630-8a40-722c73b55994 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:04.321548 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d8f165a0-3fe8-4630-8a40-722c73b55994 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073374 May 24 15:43:04.322447 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 317/592] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:43:04 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:05.340185 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-cd07a9ba-bdba-4b8f-80bb-9fb834bdc306 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:05.347053 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-cd07a9ba-bdba-4b8f-80bb-9fb834bdc306 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:05.355323 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cd07a9ba-bdba-4b8f-80bb-9fb834bdc306 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:05.356167 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cd07a9ba-bdba-4b8f-80bb-9fb834bdc306 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:05.357423 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cd07a9ba-bdba-4b8f-80bb-9fb834bdc306 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:05.358075 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cd07a9ba-bdba-4b8f-80bb-9fb834bdc306 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:05.401549 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-cd07a9ba-bdba-4b8f-80bb-9fb834bdc306 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070558 May 24 15:43:05.402141 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 276/593] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:43:05 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:43:05.489650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0976336e-b852-458c-b30f-15d3b06629bc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:05.490876 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0976336e-b852-458c-b30f-15d3b06629bc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:05.498161 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0976336e-b852-458c-b30f-15d3b06629bc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:05.498992 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0976336e-b852-458c-b30f-15d3b06629bc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:05.499984 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0976336e-b852-458c-b30f-15d3b06629bc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:05.500651 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0976336e-b852-458c-b30f-15d3b06629bc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:05.534430 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0976336e-b852-458c-b30f-15d3b06629bc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Going to try to terminate instance {{(pid=129340) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:43:05.631781 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0976336e-b852-458c-b30f-15d3b06629bc tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 204 len: 0 microversion: 2.1 time: 0.147736 May 24 15:43:05.633018 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 318/594] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:43:05 2022] DELETE /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:43:05.641071 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-64350123-2489-48d3-9ed5-15edc513bf28 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:05.641680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-64350123-2489-48d3-9ed5-15edc513bf28 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:05.648790 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-64350123-2489-48d3-9ed5-15edc513bf28 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:05.649250 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-64350123-2489-48d3-9ed5-15edc513bf28 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:05.650213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-64350123-2489-48d3-9ed5-15edc513bf28 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:05.650790 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-64350123-2489-48d3-9ed5-15edc513bf28 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:05.835720 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-64350123-2489-48d3-9ed5-15edc513bf28 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:05.845430 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-64350123-2489-48d3-9ed5-15edc513bf28 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1688 microversion: 2.1 time: 0.208148 May 24 15:43:05.848456 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 277/595] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:05 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:06.868167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4744274f-99a1-4f0f-aed0-261bcf2b3baa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:06.871337 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-4744274f-99a1-4f0f-aed0-261bcf2b3baa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:06.882704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4744274f-99a1-4f0f-aed0-261bcf2b3baa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:06.883577 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4744274f-99a1-4f0f-aed0-261bcf2b3baa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:06.884814 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4744274f-99a1-4f0f-aed0-261bcf2b3baa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:06.885418 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4744274f-99a1-4f0f-aed0-261bcf2b3baa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:07.315136 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-4744274f-99a1-4f0f-aed0-261bcf2b3baa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:07.322684 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-4744274f-99a1-4f0f-aed0-261bcf2b3baa tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1688 microversion: 2.1 time: 0.463702 May 24 15:43:07.332469 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 319/596] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:06 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1688 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:08.343525 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-de585ccc-4110-488a-a253-4aa2351c51cf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:08.345513 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-de585ccc-4110-488a-a253-4aa2351c51cf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:08.357679 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-de585ccc-4110-488a-a253-4aa2351c51cf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:08.358502 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-de585ccc-4110-488a-a253-4aa2351c51cf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:08.359547 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-de585ccc-4110-488a-a253-4aa2351c51cf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:08.361208 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-de585ccc-4110-488a-a253-4aa2351c51cf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:08.544173 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-de585ccc-4110-488a-a253-4aa2351c51cf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:08.563670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-de585ccc-4110-488a-a253-4aa2351c51cf tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1688 microversion: 2.1 time: 0.227310 May 24 15:43:08.564362 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 278/597] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:08 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1688 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:09.582908 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d073d077-eb03-43d9-8d1a-c364c3af6abe tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:09.583522 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d073d077-eb03-43d9-8d1a-c364c3af6abe tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:09.593519 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d073d077-eb03-43d9-8d1a-c364c3af6abe tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:09.593964 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d073d077-eb03-43d9-8d1a-c364c3af6abe tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:09.600253 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d073d077-eb03-43d9-8d1a-c364c3af6abe tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:09.600743 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d073d077-eb03-43d9-8d1a-c364c3af6abe tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:10.219152 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d073d077-eb03-43d9-8d1a-c364c3af6abe tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:10.231386 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d073d077-eb03-43d9-8d1a-c364c3af6abe tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1688 microversion: 2.1 time: 0.652244 May 24 15:43:10.232994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 320/598] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:09 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1688 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:10.826651 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-7b4cafff-1dab-43ac-9aaf-bf4feb38367e req-6aff089b-a705-45a4-a6e5-ab8dc68dafce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f726278-c770-47b5-86db-c95db49ba80f", "name": "network-vif-deleted", "tag": "123b7faa-d212-4186-93a9-6e1d900b7f9c"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:10.844339 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-7b4cafff-1dab-43ac-9aaf-bf4feb38367e req-6aff089b-a705-45a4-a6e5-ab8dc68dafce service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:10.844779 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-7b4cafff-1dab-43ac-9aaf-bf4feb38367e req-6aff089b-a705-45a4-a6e5-ab8dc68dafce service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:10.859914 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-7b4cafff-1dab-43ac-9aaf-bf4feb38367e req-6aff089b-a705-45a4-a6e5-ab8dc68dafce service nova] Creating event network-vif-deleted:123b7faa-d212-4186-93a9-6e1d900b7f9c for instance 3f726278-c770-47b5-86db-c95db49ba80f on hv-cinder-84315 May 24 15:43:10.865325 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-7b4cafff-1dab-43ac-9aaf-bf4feb38367e req-6aff089b-a705-45a4-a6e5-ab8dc68dafce service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042316 May 24 15:43:10.866465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 279/599] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:11.249758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:11.250366 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:11.257186 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:11.257877 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:11.258843 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:11.259422 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:11.328124 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:11.328559 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:11.329013 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'fault' on Instance uuid 3f726278-c770-47b5-86db-c95db49ba80f {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:11.415480 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:11.424741 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-98fc6eb0-0515-4274-b814-1b68aaf0881e tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 200 len: 1334 microversion: 2.1 time: 0.179332 May 24 15:43:11.425301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 321/600] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:11 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 1334 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:12.443372 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7b012744-1b02-434c-aa1d-700a8215d8f7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:12.445208 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7b012744-1b02-434c-aa1d-700a8215d8f7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 3f726278-c770-47b5-86db-c95db49ba80f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:12.454299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b012744-1b02-434c-aa1d-700a8215d8f7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:12.455315 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b012744-1b02-434c-aa1d-700a8215d8f7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:12.456319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b012744-1b02-434c-aa1d-700a8215d8f7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:12.457090 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b012744-1b02-434c-aa1d-700a8215d8f7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:12.472727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-7b012744-1b02-434c-aa1d-700a8215d8f7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] HTTP exception thrown: Instance 3f726278-c770-47b5-86db-c95db49ba80f could not be found. May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7b012744-1b02-434c-aa1d-700a8215d8f7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Request method failure captured: May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f HTTP/1.1 May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPvlT08falb-kbxErhnH4y_YxizG-iXi7Na5jtycP_ZDumNGA-LHP5Tl6lKn2dWP3vNAS8YgpJpxxPPoLUw_y5zCzNXpLx-D48XlgwdXZ_qVCv6JBhiW29zgII-w90Qp5k2SHhtWG5PB3Fp9pK6GeYy1i1bySozFoQa1X8Er2a4uxu8 May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: e280d545f6064b5c91289a77e2491511 May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:43:12.475569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e280d545f6064b5c91289a77e2491511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e280d545f6064b5c91289a77e2491511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e280d545f6064b5c91289a77e2491511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e280d545f6064b5c91289a77e2491511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: e280d545f6064b5c91289a77e2491511 May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-ServerRescueNegativeTestJSON-2086104122-project May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 6d07884e92bc4cfe95d2fd99c40f25f0 May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086104122-project May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance 3f726278-c770-47b5-86db-c95db49ba80f could not be found. May 24 15:43:12.477465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': '3f726278-c770-47b5-86db-c95db49ba80f'} May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f726278-c770-47b5-86db-c95db49ba80f could not be found. May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:43:12.478410 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f726278-c770-47b5-86db-c95db49ba80f could not be found. May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f726278-c770-47b5-86db-c95db49ba80f could not be found. May 24 15:43:12.479888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:43:12.481991 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7b012744-1b02-434c-aa1d-700a8215d8f7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Returning 404 to user: Instance 3f726278-c770-47b5-86db-c95db49ba80f could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:43:12.482893 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7b012744-1b02-434c-aa1d-700a8215d8f7 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f" status: 404 len: 111 microversion: 2.1 time: 0.044601 May 24 15:43:12.484304 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 280/601] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:12 2022] GET /compute/v2.1/servers/3f726278-c770-47b5-86db-c95db49ba80f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:43:12.495463 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-06d1b8a0-9538-44a5-8e29-2ec9e1d10d97 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '.version_select at 0x7fb1d48e9670>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:12.520136 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-06d1b8a0-9538-44a5-8e29-2ec9e1d10d97 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-114222139" status: 202 len: 0 microversion: 2.1 time: 0.030987 May 24 15:43:12.538888 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 322/602] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 24 15:43:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-114222139 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:43:15.955671 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a8dd2486-ac64-4a31-b24a-ef35c4787957 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:15.956515 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a8dd2486-ac64-4a31-b24a-ef35c4787957 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:15.963805 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8dd2486-ac64-4a31-b24a-ef35c4787957 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:15.964273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8dd2486-ac64-4a31-b24a-ef35c4787957 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:15.965248 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8dd2486-ac64-4a31-b24a-ef35c4787957 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:15.965699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a8dd2486-ac64-4a31-b24a-ef35c4787957 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:15.999868 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a8dd2486-ac64-4a31-b24a-ef35c4787957 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:43:16.089032 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a8dd2486-ac64-4a31-b24a-ef35c4787957 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "DELETE /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 204 len: 0 microversion: 2.1 time: 0.136874 May 24 15:43:16.090217 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 281/603] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:43:15 2022] DELETE /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:43:16.099595 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8185a4cf-56ff-4699-88ec-973d29ea298f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:16.100575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8185a4cf-56ff-4699-88ec-973d29ea298f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:16.107182 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8185a4cf-56ff-4699-88ec-973d29ea298f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:16.107712 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8185a4cf-56ff-4699-88ec-973d29ea298f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:16.108954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8185a4cf-56ff-4699-88ec-973d29ea298f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:16.109536 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8185a4cf-56ff-4699-88ec-973d29ea298f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:16.291177 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8185a4cf-56ff-4699-88ec-973d29ea298f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:16.300141 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8185a4cf-56ff-4699-88ec-973d29ea298f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1506 microversion: 2.1 time: 0.205575 May 24 15:43:16.301100 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 323/604] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:16 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:17.318534 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-032a9b53-d156-49fb-a81c-83561b03c3ae tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:17.319994 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-032a9b53-d156-49fb-a81c-83561b03c3ae tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:17.326984 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-032a9b53-d156-49fb-a81c-83561b03c3ae tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:17.327572 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-032a9b53-d156-49fb-a81c-83561b03c3ae tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:17.328633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-032a9b53-d156-49fb-a81c-83561b03c3ae tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:17.329145 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-032a9b53-d156-49fb-a81c-83561b03c3ae tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:17.475125 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-032a9b53-d156-49fb-a81c-83561b03c3ae tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:17.485296 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-032a9b53-d156-49fb-a81c-83561b03c3ae tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1506 microversion: 2.1 time: 0.171071 May 24 15:43:17.486158 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 282/605] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:17 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:18.503962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-dd2aee9c-2684-4fe1-8ca4-220a9ad382dd tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:18.505523 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-dd2aee9c-2684-4fe1-8ca4-220a9ad382dd tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:18.513462 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dd2aee9c-2684-4fe1-8ca4-220a9ad382dd tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:18.514148 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dd2aee9c-2684-4fe1-8ca4-220a9ad382dd tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:18.515161 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dd2aee9c-2684-4fe1-8ca4-220a9ad382dd tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:18.515822 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-dd2aee9c-2684-4fe1-8ca4-220a9ad382dd tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:18.698796 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-dd2aee9c-2684-4fe1-8ca4-220a9ad382dd tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:18.706451 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-dd2aee9c-2684-4fe1-8ca4-220a9ad382dd tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 200 len: 1506 microversion: 2.1 time: 0.208440 May 24 15:43:18.716895 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 324/606] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:18 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:18.965880 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-02032638-77f2-43e8-b5bf-68bd26d733a8 req-51ae5915-0cfa-442c-a457-00e64139173c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d791b8-2dce-43c8-9faa-5af5f5e14d65", "name": "network-vif-deleted", "tag": "e827b410-d904-420a-8600-036fec1a80f7"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:18.977892 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-02032638-77f2-43e8-b5bf-68bd26d733a8 req-51ae5915-0cfa-442c-a457-00e64139173c service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:18.978328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-02032638-77f2-43e8-b5bf-68bd26d733a8 req-51ae5915-0cfa-442c-a457-00e64139173c service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:19.001449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-02032638-77f2-43e8-b5bf-68bd26d733a8 req-51ae5915-0cfa-442c-a457-00e64139173c service nova] Creating event network-vif-deleted:e827b410-d904-420a-8600-036fec1a80f7 for instance 84d791b8-2dce-43c8-9faa-5af5f5e14d65 on hv-cinder-84315 May 24 15:43:19.008848 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-02032638-77f2-43e8-b5bf-68bd26d733a8 req-51ae5915-0cfa-442c-a457-00e64139173c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047273 May 24 15:43:19.009452 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 283/607] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:19.723610 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-686817bd-b0d5-4913-8ea5-c9fc12028ec3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:19.724245 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-686817bd-b0d5-4913-8ea5-c9fc12028ec3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 84d791b8-2dce-43c8-9faa-5af5f5e14d65] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:19.731167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-686817bd-b0d5-4913-8ea5-c9fc12028ec3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:19.731611 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-686817bd-b0d5-4913-8ea5-c9fc12028ec3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:19.732409 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-686817bd-b0d5-4913-8ea5-c9fc12028ec3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:19.732836 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-686817bd-b0d5-4913-8ea5-c9fc12028ec3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:19.747732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-686817bd-b0d5-4913-8ea5-c9fc12028ec3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] HTTP exception thrown: Instance 84d791b8-2dce-43c8-9faa-5af5f5e14d65 could not be found. May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-686817bd-b0d5-4913-8ea5-c9fc12028ec3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Request method failure captured: May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 HTTP/1.1 May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPvlT08falb-kbxErhnH4y_YxizG-iXi7Na5jtycP_ZDumNGA-LHP5Tl6lKn2dWP3vNAS8YgpJpxxPPoLUw_y5zCzNXpLx-D48XlgwdXZ_qVCv6JBhiW29zgII-w90Qp5k2SHhtWG5PB3Fp9pK6GeYy1i1bySozFoQa1X8Er2a4uxu8 May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: e280d545f6064b5c91289a77e2491511 May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:43:19.749455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e280d545f6064b5c91289a77e2491511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e280d545f6064b5c91289a77e2491511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e280d545f6064b5c91289a77e2491511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e280d545f6064b5c91289a77e2491511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: e280d545f6064b5c91289a77e2491511 May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-ServerRescueNegativeTestJSON-2086104122-project May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 6d07884e92bc4cfe95d2fd99c40f25f0 May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086104122-project May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 84d791b8-2dce-43c8-9faa-5af5f5e14d65 could not be found. May 24 15:43:19.751171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '84d791b8-2dce-43c8-9faa-5af5f5e14d65'} May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d791b8-2dce-43c8-9faa-5af5f5e14d65 could not be found. May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:43:19.752278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d791b8-2dce-43c8-9faa-5af5f5e14d65 could not be found. May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d791b8-2dce-43c8-9faa-5af5f5e14d65 could not be found. May 24 15:43:19.753774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:43:19.755758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-686817bd-b0d5-4913-8ea5-c9fc12028ec3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Returning 404 to user: Instance 84d791b8-2dce-43c8-9faa-5af5f5e14d65 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:43:19.755758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-686817bd-b0d5-4913-8ea5-c9fc12028ec3 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65" status: 404 len: 111 microversion: 2.1 time: 0.031624 May 24 15:43:19.755758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 325/608] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:19 2022] GET /compute/v2.1/servers/84d791b8-2dce-43c8-9faa-5af5f5e14d65 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:43:19.761751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bb43ae57-fb5f-4bb1-b927-756fd247641d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:19.762331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bb43ae57-fb5f-4bb1-b927-756fd247641d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:19.770400 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bb43ae57-fb5f-4bb1-b927-756fd247641d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:19.771062 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bb43ae57-fb5f-4bb1-b927-756fd247641d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:19.771856 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bb43ae57-fb5f-4bb1-b927-756fd247641d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:19.772319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bb43ae57-fb5f-4bb1-b927-756fd247641d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:19.804010 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bb43ae57-fb5f-4bb1-b927-756fd247641d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:43:19.895520 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bb43ae57-fb5f-4bb1-b927-756fd247641d tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "DELETE /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 204 len: 0 microversion: 2.1 time: 0.137722 May 24 15:43:19.897340 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 284/609] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:43:19 2022] DELETE /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:43:19.911921 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-88e33aca-6162-49ed-9063-34eb21c7e18a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:19.912571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-88e33aca-6162-49ed-9063-34eb21c7e18a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:19.920129 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-88e33aca-6162-49ed-9063-34eb21c7e18a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:19.920573 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-88e33aca-6162-49ed-9063-34eb21c7e18a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:19.921328 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-88e33aca-6162-49ed-9063-34eb21c7e18a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:19.921998 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-88e33aca-6162-49ed-9063-34eb21c7e18a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:20.056840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-88e33aca-6162-49ed-9063-34eb21c7e18a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:20.064787 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-88e33aca-6162-49ed-9063-34eb21c7e18a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.161507 May 24 15:43:20.072069 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 326/610] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:19 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:20.306539 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7e0cb08d-1068-4fa5-a11a-853d16d772b9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Action: 'create', calling method: .version_select at 0x7fb1d5243280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1006083692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK09cM0hDpbzzzEIdFd9Rf64flVSf3/PhPNHHHEHZowOQTj1/UO+Qdw1o/VgQXYH8gDLzjMr+8WY1TBX5GpKPfLXKvlYEyY7YxTJ9/ctQe9onVCnTzaFTFB9kyKWxtOeGQ=="}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:20.321220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-7e0cb08d-1068-4fa5-a11a-853d16d772b9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Getting quotas for project b05a5e216dd141dabe29dfc71abee8ee. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:43:20.325085 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-7e0cb08d-1068-4fa5-a11a-853d16d772b9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Getting quotas for user 423be519855441a6863badc453828bea and project b05a5e216dd141dabe29dfc71abee8ee. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:43:20.351326 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7e0cb08d-1068-4fa5-a11a-853d16d772b9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049045 May 24 15:43:20.351899 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 285/611] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 24 15:43:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:20.403131 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1615091415", "imageRef": "a0b4e73e-1260-4164-b753-15d9b7a3ab65", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1006083692", "networks": [{"uuid": "fd83f345-ebd0-49b8-b33c-ab3471ac601b"}]}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:20.455562 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] validate_networks() for [('fd83f345-ebd0-49b8-b33c-ab3471ac601b', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:43:20.908183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:43:20.908833 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:43:20.909179 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:43:20.909659 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:43:20.910229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:43:20.924521 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:20.924944 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:20.925776 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:20.926211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:20.942965 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Getting quotas for project b05a5e216dd141dabe29dfc71abee8ee. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:43:20.947664 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Getting quotas for user 423be519855441a6863badc453828bea and project b05a5e216dd141dabe29dfc71abee8ee. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:43:20.959367 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:43:20.961655 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0b4e73e-1260-4164-b753-15d9b7a3ab65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:43:21.007903 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-21e14100-0298-458a-9cbd-00dc14ff548a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608653 May 24 15:43:21.008579 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 327/612] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:43:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:43:21.019079 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-8c0c7aa9-b9f8-4fff-aa2c-07accc15d1a9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:21.019842 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8c0c7aa9-b9f8-4fff-aa2c-07accc15d1a9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:21.075813 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8c0c7aa9-b9f8-4fff-aa2c-07accc15d1a9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:21.083432 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fe828cec-efdc-4c95-9bd2-36d5d45bd9f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:21.083773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-8c0c7aa9-b9f8-4fff-aa2c-07accc15d1a9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1259 microversion: 2.1 time: 0.069063 May 24 15:43:21.084057 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fe828cec-efdc-4c95-9bd2-36d5d45bd9f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:21.084562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 286/613] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:21 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:21.094693 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe828cec-efdc-4c95-9bd2-36d5d45bd9f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:21.095289 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe828cec-efdc-4c95-9bd2-36d5d45bd9f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:21.096078 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe828cec-efdc-4c95-9bd2-36d5d45bd9f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:21.096515 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fe828cec-efdc-4c95-9bd2-36d5d45bd9f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:21.236334 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fe828cec-efdc-4c95-9bd2-36d5d45bd9f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:21.244057 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fe828cec-efdc-4c95-9bd2-36d5d45bd9f8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.165992 May 24 15:43:21.244627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 328/614] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:21 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:22.105128 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3644580a-6375-4ea6-b62c-90b345db2108 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:22.106142 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3644580a-6375-4ea6-b62c-90b345db2108 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:22.114813 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3644580a-6375-4ea6-b62c-90b345db2108 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:22.115266 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3644580a-6375-4ea6-b62c-90b345db2108 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:22.116021 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3644580a-6375-4ea6-b62c-90b345db2108 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:22.116487 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3644580a-6375-4ea6-b62c-90b345db2108 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:22.188238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-3644580a-6375-4ea6-b62c-90b345db2108 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:22.196077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3644580a-6375-4ea6-b62c-90b345db2108 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1263 microversion: 2.1 time: 0.097446 May 24 15:43:22.196683 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 287/615] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:22 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:22.261992 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-765d349d-0d71-434d-85f6-95aa2f76fbff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:22.263272 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-765d349d-0d71-434d-85f6-95aa2f76fbff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:22.270787 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-765d349d-0d71-434d-85f6-95aa2f76fbff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:22.271233 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-765d349d-0d71-434d-85f6-95aa2f76fbff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:22.271998 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-765d349d-0d71-434d-85f6-95aa2f76fbff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:22.272463 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-765d349d-0d71-434d-85f6-95aa2f76fbff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:22.406489 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-765d349d-0d71-434d-85f6-95aa2f76fbff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:22.417722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-765d349d-0d71-434d-85f6-95aa2f76fbff tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.159429 May 24 15:43:22.418461 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 329/616] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:22 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:23.214108 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-dad9556a-a5b6-40a7-85ef-0539f3cd635b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:23.214721 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-dad9556a-a5b6-40a7-85ef-0539f3cd635b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:23.222068 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dad9556a-a5b6-40a7-85ef-0539f3cd635b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:23.222498 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dad9556a-a5b6-40a7-85ef-0539f3cd635b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:23.223466 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dad9556a-a5b6-40a7-85ef-0539f3cd635b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:23.224105 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dad9556a-a5b6-40a7-85ef-0539f3cd635b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:23.289593 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-dad9556a-a5b6-40a7-85ef-0539f3cd635b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:23.298071 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-dad9556a-a5b6-40a7-85ef-0539f3cd635b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1311 microversion: 2.1 time: 0.087929 May 24 15:43:23.298992 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 288/617] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:23 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:23.440735 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a0d24bda-6c37-45d7-8525-934f76628fdb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:23.441410 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a0d24bda-6c37-45d7-8525-934f76628fdb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:23.449402 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0d24bda-6c37-45d7-8525-934f76628fdb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:23.449919 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0d24bda-6c37-45d7-8525-934f76628fdb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:23.450794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0d24bda-6c37-45d7-8525-934f76628fdb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:23.451294 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0d24bda-6c37-45d7-8525-934f76628fdb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:23.688854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a0d24bda-6c37-45d7-8525-934f76628fdb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:23.698651 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a0d24bda-6c37-45d7-8525-934f76628fdb tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1521 microversion: 2.1 time: 0.263787 May 24 15:43:23.699471 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 330/618] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:23 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:23.966201 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-a63abe54-aa93-46bf-bf03-d8c071048bb6 req-9dd62835-0fcc-41c4-be4b-5d1aea2d9ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69fdd945-52b6-4e16-9cd0-06bf19fc5536", "name": "network-vif-deleted", "tag": "110b6658-6aab-4863-9381-91ebcbd0ce77"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:23.979884 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-a63abe54-aa93-46bf-bf03-d8c071048bb6 req-9dd62835-0fcc-41c4-be4b-5d1aea2d9ff2 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:23.980455 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-a63abe54-aa93-46bf-bf03-d8c071048bb6 req-9dd62835-0fcc-41c4-be4b-5d1aea2d9ff2 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:24.005414 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-a63abe54-aa93-46bf-bf03-d8c071048bb6 req-9dd62835-0fcc-41c4-be4b-5d1aea2d9ff2 service nova] Creating event network-vif-deleted:110b6658-6aab-4863-9381-91ebcbd0ce77 for instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 on hv-cinder-84315 May 24 15:43:24.011567 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-a63abe54-aa93-46bf-bf03-d8c071048bb6 req-9dd62835-0fcc-41c4-be4b-5d1aea2d9ff2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050972 May 24 15:43:24.012485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 289/619] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:24.315903 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-59a327a7-5241-4adf-841d-9825ff5c1530 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:24.316568 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-59a327a7-5241-4adf-841d-9825ff5c1530 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:24.329954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-59a327a7-5241-4adf-841d-9825ff5c1530 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:24.330396 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-59a327a7-5241-4adf-841d-9825ff5c1530 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:24.331215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-59a327a7-5241-4adf-841d-9825ff5c1530 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:24.333701 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-59a327a7-5241-4adf-841d-9825ff5c1530 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:24.577148 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-59a327a7-5241-4adf-841d-9825ff5c1530 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:24.588196 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-59a327a7-5241-4adf-841d-9825ff5c1530 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.276266 May 24 15:43:24.589784 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 331/620] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:24 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:24.717562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:24.718571 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:24.729698 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:24.737625 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:24.738775 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:24.739205 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:24.781481 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:24.782819 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:24.783343 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'fault' on Instance uuid 69fdd945-52b6-4e16-9cd0-06bf19fc5536 {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:24.833451 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:24.841645 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e602bc1b-fe81-4af8-add4-2cbd1f257e16 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1312 microversion: 2.1 time: 0.129283 May 24 15:43:24.842465 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 290/621] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:24 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1312 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:25.607117 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-43381f64-de01-45dd-bd89-217ebb328a68 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:25.607699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-43381f64-de01-45dd-bd89-217ebb328a68 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:25.614579 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-43381f64-de01-45dd-bd89-217ebb328a68 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:25.615025 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-43381f64-de01-45dd-bd89-217ebb328a68 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:25.615787 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-43381f64-de01-45dd-bd89-217ebb328a68 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:25.616287 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-43381f64-de01-45dd-bd89-217ebb328a68 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:25.757664 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-43381f64-de01-45dd-bd89-217ebb328a68 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:25.765221 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-43381f64-de01-45dd-bd89-217ebb328a68 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.162271 May 24 15:43:25.765779 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 332/622] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:25 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:25.858966 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:25.859589 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:25.866795 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:25.867235 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:25.867988 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:25.868437 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:25.901263 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:25.901703 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:25.902166 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'fault' on Instance uuid 69fdd945-52b6-4e16-9cd0-06bf19fc5536 {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:25.905243 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:25.952940 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:25.960630 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-04b545b9-1c0e-4f83-97b5-f7dc060acc4a tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1312 microversion: 2.1 time: 0.105658 May 24 15:43:25.961392 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 291/623] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:25 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:26.782874 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-eec46e66-3404-4a82-96a5-e3ea7a2766ed tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:26.783500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-eec46e66-3404-4a82-96a5-e3ea7a2766ed tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:26.790348 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eec46e66-3404-4a82-96a5-e3ea7a2766ed tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:26.790770 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eec46e66-3404-4a82-96a5-e3ea7a2766ed tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:26.791560 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eec46e66-3404-4a82-96a5-e3ea7a2766ed tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:26.791992 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eec46e66-3404-4a82-96a5-e3ea7a2766ed tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:26.926292 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-eec46e66-3404-4a82-96a5-e3ea7a2766ed tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:26.929936 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:26.934788 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-eec46e66-3404-4a82-96a5-e3ea7a2766ed tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.155885 May 24 15:43:26.935556 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 333/624] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:26 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:26.977810 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:26.978600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:26.985403 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:26.985976 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:26.987321 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:26.987932 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:27.024880 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:27.025322 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:27.025770 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'fault' on Instance uuid 69fdd945-52b6-4e16-9cd0-06bf19fc5536 {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:27.072753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:27.080908 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-47492e45-d2c7-42f3-87aa-3063f952876f tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1312 microversion: 2.1 time: 0.107081 May 24 15:43:27.081481 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 292/625] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:26 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:27.952775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b582b509-b047-4d1d-84c7-47212bf4a96d tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:27.953668 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b582b509-b047-4d1d-84c7-47212bf4a96d tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:27.962205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b582b509-b047-4d1d-84c7-47212bf4a96d tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:27.962879 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b582b509-b047-4d1d-84c7-47212bf4a96d tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:27.963674 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b582b509-b047-4d1d-84c7-47212bf4a96d tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:27.964090 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b582b509-b047-4d1d-84c7-47212bf4a96d tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:28.098349 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:28.102218 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b582b509-b047-4d1d-84c7-47212bf4a96d tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:28.103169 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:28.109792 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:28.110005 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b582b509-b047-4d1d-84c7-47212bf4a96d tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.161623 May 24 15:43:28.110869 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:28.111787 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:28.112317 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:28.119989 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 334/626] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:27 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:28.148000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:28.148396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:28.148850 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'fault' on Instance uuid 69fdd945-52b6-4e16-9cd0-06bf19fc5536 {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:28.192285 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:28.200280 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6caa4287-b6bd-4afe-8f3e-494e4f410205 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1312 microversion: 2.1 time: 0.105986 May 24 15:43:28.201088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 293/627] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:28 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:29.056383 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3426cf46-c908-42e0-8073-e689a8e4de2a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:29.056925 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3426cf46-c908-42e0-8073-e689a8e4de2a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:29.064529 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3426cf46-c908-42e0-8073-e689a8e4de2a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.065062 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3426cf46-c908-42e0-8073-e689a8e4de2a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.065827 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3426cf46-c908-42e0-8073-e689a8e4de2a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.066458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3426cf46-c908-42e0-8073-e689a8e4de2a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.091634 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3426cf46-c908-42e0-8073-e689a8e4de2a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/ips" status: 200 len: 151 microversion: 2.20 time: 0.161118 May 24 15:43:29.092418 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 335/628] 10.222.0.55 () {60 vars in 1288 bytes} [Tue May 24 15:43:28 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/ips => generated 151 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 15:43:29.127608 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-05b07efd-3a6b-444a-9f0f-4ad282dbf69f tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:29.129423 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-05b07efd-3a6b-444a-9f0f-4ad282dbf69f tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:29.140732 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-05b07efd-3a6b-444a-9f0f-4ad282dbf69f tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.141487 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-05b07efd-3a6b-444a-9f0f-4ad282dbf69f tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.143154 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-05b07efd-3a6b-444a-9f0f-4ad282dbf69f tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.144194 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-05b07efd-3a6b-444a-9f0f-4ad282dbf69f tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.218705 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:29.219489 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:29.227583 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.228097 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.228862 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.229291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.273244 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:29.273755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:29.274198 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'fault' on Instance uuid 69fdd945-52b6-4e16-9cd0-06bf19fc5536 {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:29.335560 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:29.344159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c81ff725-26d7-412f-8473-f366536e7fc8 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1312 microversion: 2.1 time: 0.130151 May 24 15:43:29.344909 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 336/629] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:29 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:29.382655 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-05b07efd-3a6b-444a-9f0f-4ad282dbf69f tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:29.401475 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-05b07efd-3a6b-444a-9f0f-4ad282dbf69f tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.278485 May 24 15:43:29.405434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 294/630] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:29 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:30.361520 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:30.362126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:30.370652 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:30.371096 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:30.371866 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:30.372337 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:30.406737 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:30.407070 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:30.407461 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'fault' on Instance uuid 69fdd945-52b6-4e16-9cd0-06bf19fc5536 {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:30.425411 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2c8fd8e9-c698-4744-8c22-100e17159906 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:30.426170 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2c8fd8e9-c698-4744-8c22-100e17159906 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:30.433381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2c8fd8e9-c698-4744-8c22-100e17159906 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:30.434115 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2c8fd8e9-c698-4744-8c22-100e17159906 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:30.435114 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2c8fd8e9-c698-4744-8c22-100e17159906 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:30.435692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2c8fd8e9-c698-4744-8c22-100e17159906 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:30.455050 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:30.472476 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-33f8d3fd-d5ba-44fb-8abb-d78c327eeb40 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1312 microversion: 2.1 time: 0.114727 May 24 15:43:30.484872 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 337/631] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:30 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1312 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:30.703162 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2c8fd8e9-c698-4744-8c22-100e17159906 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:30.712637 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2c8fd8e9-c698-4744-8c22-100e17159906 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.291203 May 24 15:43:30.714097 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 295/632] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:30 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:31.142175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8766637b-7f3d-41df-a8ae-c5253bc062a5 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:31.143580 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8766637b-7f3d-41df-a8ae-c5253bc062a5 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:31.145773 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:31.146421 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=6 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:31.153725 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8766637b-7f3d-41df-a8ae-c5253bc062a5 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.154467 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8766637b-7f3d-41df-a8ae-c5253bc062a5 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.155487 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8766637b-7f3d-41df-a8ae-c5253bc062a5 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.156063 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8766637b-7f3d-41df-a8ae-c5253bc062a5 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.180773 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-8766637b-7f3d-41df-a8ae-c5253bc062a5 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lazy-loading 'flavor' on Instance uuid 92a52505-bbe8-48c0-ba6f-ec99a6980285 {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:31.463196 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8766637b-7f3d-41df-a8ae-c5253bc062a5 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "POST /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/action" status: 202 len: 0 microversion: 2.20 time: 0.324873 May 24 15:43:31.468223 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 338/633] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 24 15:43:31 2022] POST /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 15:43:31.473700 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-66e01687-a3cb-4146-9870-67c95f7a00d7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:31.477932 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-66e01687-a3cb-4146-9870-67c95f7a00d7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:31.485944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=6 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:31.495215 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-66e01687-a3cb-4146-9870-67c95f7a00d7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.495689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-66e01687-a3cb-4146-9870-67c95f7a00d7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.496059 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:31.496535 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-66e01687-a3cb-4146-9870-67c95f7a00d7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.496964 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-66e01687-a3cb-4146-9870-67c95f7a00d7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.497081 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:31.512329 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.512329 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.512329 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.513449 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.555890 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.556355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.556806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'fault' on Instance uuid 69fdd945-52b6-4e16-9cd0-06bf19fc5536 {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:31.607089 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:31.618477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fccd24e7-2293-44de-a294-e3504af2f177 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1312 microversion: 2.1 time: 0.129220 May 24 15:43:31.627839 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 339/634] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:31 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1312 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:31.677160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-66e01687-a3cb-4146-9870-67c95f7a00d7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:31.685607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-66e01687-a3cb-4146-9870-67c95f7a00d7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:31.687019 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-66e01687-a3cb-4146-9870-67c95f7a00d7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:31.688212 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-66e01687-a3cb-4146-9870-67c95f7a00d7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.220207 May 24 15:43:31.688766 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 296/635] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:31 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:43:31.730411 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b4dde524-872d-4769-92a0-a80bb5d7d8ec tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:31.731510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b4dde524-872d-4769-92a0-a80bb5d7d8ec tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:31.739182 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b4dde524-872d-4769-92a0-a80bb5d7d8ec tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.739621 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b4dde524-872d-4769-92a0-a80bb5d7d8ec tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.743455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b4dde524-872d-4769-92a0-a80bb5d7d8ec tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:31.744063 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b4dde524-872d-4769-92a0-a80bb5d7d8ec tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:31.888825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b4dde524-872d-4769-92a0-a80bb5d7d8ec tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:31.897335 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b4dde524-872d-4769-92a0-a80bb5d7d8ec tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.170830 May 24 15:43:31.898119 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 340/636] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:31 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:32.638409 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:32.639025 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:32.646851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:32.647277 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:32.648052 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:32.648503 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:32.682071 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:32.682541 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:32.683013 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lazy-loading 'fault' on Instance uuid 69fdd945-52b6-4e16-9cd0-06bf19fc5536 {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:43:32.707439 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1bd5ed4c-ce65-4e93-83fd-e7c9975ce5e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:32.708105 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1bd5ed4c-ce65-4e93-83fd-e7c9975ce5e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:32.714931 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1bd5ed4c-ce65-4e93-83fd-e7c9975ce5e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:32.715460 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1bd5ed4c-ce65-4e93-83fd-e7c9975ce5e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:32.716352 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1bd5ed4c-ce65-4e93-83fd-e7c9975ce5e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:32.716841 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1bd5ed4c-ce65-4e93-83fd-e7c9975ce5e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:32.725322 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d07884e92bc4cfe95d2fd99c40f25f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e280d545f6064b5c91289a77e2491511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:32.733070 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-10a22c25-61a6-4f3a-8750-dd5ce56b1686 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 200 len: 1312 microversion: 2.1 time: 0.100608 May 24 15:43:32.733736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 297/637] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:32 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:32.847245 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1bd5ed4c-ce65-4e93-83fd-e7c9975ce5e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:32.855291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1bd5ed4c-ce65-4e93-83fd-e7c9975ce5e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:32.856810 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1bd5ed4c-ce65-4e93-83fd-e7c9975ce5e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:32.857954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1bd5ed4c-ce65-4e93-83fd-e7c9975ce5e0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.155056 May 24 15:43:32.858503 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 341/638] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:32 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:32.918165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-8595d2cd-9dd1-46ef-8550-2fb35e17812b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:32.919224 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8595d2cd-9dd1-46ef-8550-2fb35e17812b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:32.929078 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8595d2cd-9dd1-46ef-8550-2fb35e17812b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:32.929548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8595d2cd-9dd1-46ef-8550-2fb35e17812b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:32.930317 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8595d2cd-9dd1-46ef-8550-2fb35e17812b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:32.930744 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8595d2cd-9dd1-46ef-8550-2fb35e17812b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:33.082612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-8595d2cd-9dd1-46ef-8550-2fb35e17812b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:33.090337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-8595d2cd-9dd1-46ef-8550-2fb35e17812b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.178578 May 24 15:43:33.091065 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 298/639] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:32 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:33.750427 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ae488714-21d3-4b66-b6ba-808309761593 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:33.751025 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ae488714-21d3-4b66-b6ba-808309761593 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] [instance: 69fdd945-52b6-4e16-9cd0-06bf19fc5536] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:33.760089 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ae488714-21d3-4b66-b6ba-808309761593 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:33.760821 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ae488714-21d3-4b66-b6ba-808309761593 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:33.761755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ae488714-21d3-4b66-b6ba-808309761593 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:33.762326 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ae488714-21d3-4b66-b6ba-808309761593 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:33.776876 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-ae488714-21d3-4b66-b6ba-808309761593 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] HTTP exception thrown: Instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 could not be found. May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ae488714-21d3-4b66-b6ba-808309761593 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Request method failure captured: May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 HTTP/1.1 May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPvlT08falb-kbxErhnH4y_YxizG-iXi7Na5jtycP_ZDumNGA-LHP5Tl6lKn2dWP3vNAS8YgpJpxxPPoLUw_y5zCzNXpLx-D48XlgwdXZ_qVCv6JBhiW29zgII-w90Qp5k2SHhtWG5PB3Fp9pK6GeYy1i1bySozFoQa1X8Er2a4uxu8 May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: e280d545f6064b5c91289a77e2491511 May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:43:33.778575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e280d545f6064b5c91289a77e2491511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e280d545f6064b5c91289a77e2491511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e280d545f6064b5c91289a77e2491511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e280d545f6064b5c91289a77e2491511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: e280d545f6064b5c91289a77e2491511 May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086104122 May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-ServerRescueNegativeTestJSON-2086104122-project May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 6d07884e92bc4cfe95d2fd99c40f25f0 May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086104122-project May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 could not be found. May 24 15:43:33.779970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '69fdd945-52b6-4e16-9cd0-06bf19fc5536'} May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 could not be found. May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:43:33.780794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 could not be found. May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 could not be found. May 24 15:43:33.782214 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:43:33.783364 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ae488714-21d3-4b66-b6ba-808309761593 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] Returning 404 to user: Instance 69fdd945-52b6-4e16-9cd0-06bf19fc5536 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:43:33.783364 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ae488714-21d3-4b66-b6ba-808309761593 tempest-ServerRescueNegativeTestJSON-2086104122 tempest-ServerRescueNegativeTestJSON-2086104122-project] 10.222.0.55 "GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536" status: 404 len: 111 microversion: 2.1 time: 0.033421 May 24 15:43:33.783364 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 342/640] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:33 2022] GET /compute/v2.1/servers/69fdd945-52b6-4e16-9cd0-06bf19fc5536 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:43:33.879742 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-eb9d2ad3-c2fd-41ca-a73d-1142f074c495 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:33.880508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-eb9d2ad3-c2fd-41ca-a73d-1142f074c495 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:33.884576 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:33.891658 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eb9d2ad3-c2fd-41ca-a73d-1142f074c495 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:33.892170 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eb9d2ad3-c2fd-41ca-a73d-1142f074c495 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:33.893390 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eb9d2ad3-c2fd-41ca-a73d-1142f074c495 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:33.893840 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eb9d2ad3-c2fd-41ca-a73d-1142f074c495 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:34.007622 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-96a2146f-7ae0-44a9-b409-c982e5dda182 req-24565b0b-f08e-4a3b-8bab-4e6fb6f4b548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b926408-71dd-454e-b9d3-7d4e0d12e270", "tag": "ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:34.024585 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-96a2146f-7ae0-44a9-b409-c982e5dda182 req-24565b0b-f08e-4a3b-8bab-4e6fb6f4b548 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:34.025175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-96a2146f-7ae0-44a9-b409-c982e5dda182 req-24565b0b-f08e-4a3b-8bab-4e6fb6f4b548 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:34.044299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-eb9d2ad3-c2fd-41ca-a73d-1142f074c495 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:34.054527 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-eb9d2ad3-c2fd-41ca-a73d-1142f074c495 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:34.055886 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-96a2146f-7ae0-44a9-b409-c982e5dda182 req-24565b0b-f08e-4a3b-8bab-4e6fb6f4b548 service nova] Creating event network-changed:ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a for instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 on hv-cinder-84315 May 24 15:43:34.056381 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-eb9d2ad3-c2fd-41ca-a73d-1142f074c495 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:34.057580 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-eb9d2ad3-c2fd-41ca-a73d-1142f074c495 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.183039 May 24 15:43:34.058471 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 299/641] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:33 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:34.062337 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-96a2146f-7ae0-44a9-b409-c982e5dda182 req-24565b0b-f08e-4a3b-8bab-4e6fb6f4b548 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065722 May 24 15:43:34.063337 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 343/642] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:43:34.107215 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f9488c47-3f77-454c-a9e9-8a125d0ad948 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:34.107831 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f9488c47-3f77-454c-a9e9-8a125d0ad948 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:34.117075 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f9488c47-3f77-454c-a9e9-8a125d0ad948 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:34.117579 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f9488c47-3f77-454c-a9e9-8a125d0ad948 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:34.118638 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f9488c47-3f77-454c-a9e9-8a125d0ad948 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:34.119731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f9488c47-3f77-454c-a9e9-8a125d0ad948 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:34.261118 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f9488c47-3f77-454c-a9e9-8a125d0ad948 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:34.269306 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f9488c47-3f77-454c-a9e9-8a125d0ad948 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.166026 May 24 15:43:34.269930 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 300/643] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:34 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:35.077435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-270259e5-7ffa-49b5-a2d0-3f1edf773043 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:35.078334 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-270259e5-7ffa-49b5-a2d0-3f1edf773043 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:35.086091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-270259e5-7ffa-49b5-a2d0-3f1edf773043 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:35.086538 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-270259e5-7ffa-49b5-a2d0-3f1edf773043 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:35.087325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-270259e5-7ffa-49b5-a2d0-3f1edf773043 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:35.087761 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-270259e5-7ffa-49b5-a2d0-3f1edf773043 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:35.225753 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-270259e5-7ffa-49b5-a2d0-3f1edf773043 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:35.233632 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-270259e5-7ffa-49b5-a2d0-3f1edf773043 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:35.235109 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-270259e5-7ffa-49b5-a2d0-3f1edf773043 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:35.236280 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-270259e5-7ffa-49b5-a2d0-3f1edf773043 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.164222 May 24 15:43:35.236873 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 344/644] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:35 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:35.286801 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d9193b24-918b-49a6-9e0c-af87d6f92950 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:35.287553 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d9193b24-918b-49a6-9e0c-af87d6f92950 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:35.294815 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d9193b24-918b-49a6-9e0c-af87d6f92950 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:35.295264 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d9193b24-918b-49a6-9e0c-af87d6f92950 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:35.296000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d9193b24-918b-49a6-9e0c-af87d6f92950 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:35.296486 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d9193b24-918b-49a6-9e0c-af87d6f92950 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:35.446724 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d9193b24-918b-49a6-9e0c-af87d6f92950 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:35.453097 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d9193b24-918b-49a6-9e0c-af87d6f92950 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.170124 May 24 15:43:35.453947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 301/645] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:35 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:36.254834 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-27f9e4aa-9f55-4007-a2cf-3fb1ffb3a03b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:36.256614 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-27f9e4aa-9f55-4007-a2cf-3fb1ffb3a03b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:36.263340 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:36.266211 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-27f9e4aa-9f55-4007-a2cf-3fb1ffb3a03b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:36.266854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-27f9e4aa-9f55-4007-a2cf-3fb1ffb3a03b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:36.268688 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-27f9e4aa-9f55-4007-a2cf-3fb1ffb3a03b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:36.269275 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-27f9e4aa-9f55-4007-a2cf-3fb1ffb3a03b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:36.470367 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4297c6f5-0c29-4843-9587-f065322e9cda tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:36.471148 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4297c6f5-0c29-4843-9587-f065322e9cda tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:36.478504 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4297c6f5-0c29-4843-9587-f065322e9cda tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:36.479873 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4297c6f5-0c29-4843-9587-f065322e9cda tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:36.480757 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4297c6f5-0c29-4843-9587-f065322e9cda tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:36.481250 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4297c6f5-0c29-4843-9587-f065322e9cda tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:36.569579 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-27f9e4aa-9f55-4007-a2cf-3fb1ffb3a03b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:36.578148 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-27f9e4aa-9f55-4007-a2cf-3fb1ffb3a03b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:36.579620 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-27f9e4aa-9f55-4007-a2cf-3fb1ffb3a03b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:36.580838 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-27f9e4aa-9f55-4007-a2cf-3fb1ffb3a03b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.330088 May 24 15:43:36.581612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 345/646] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:36 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:36.681151 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4297c6f5-0c29-4843-9587-f065322e9cda tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:36.689623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4297c6f5-0c29-4843-9587-f065322e9cda tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.223511 May 24 15:43:36.690605 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 302/647] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:36 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:37.599207 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7bab8bfb-4f02-4217-88e4-af1cdd9b3d96 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:37.599785 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7bab8bfb-4f02-4217-88e4-af1cdd9b3d96 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:37.609458 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7bab8bfb-4f02-4217-88e4-af1cdd9b3d96 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:37.609910 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7bab8bfb-4f02-4217-88e4-af1cdd9b3d96 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:37.610800 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7bab8bfb-4f02-4217-88e4-af1cdd9b3d96 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:37.611300 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7bab8bfb-4f02-4217-88e4-af1cdd9b3d96 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:37.707076 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ff25262e-ccd2-4940-b3ef-2e8f54bfde14 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:37.708474 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ff25262e-ccd2-4940-b3ef-2e8f54bfde14 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:37.717581 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ff25262e-ccd2-4940-b3ef-2e8f54bfde14 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:37.718059 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ff25262e-ccd2-4940-b3ef-2e8f54bfde14 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:37.718828 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ff25262e-ccd2-4940-b3ef-2e8f54bfde14 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:37.720485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ff25262e-ccd2-4940-b3ef-2e8f54bfde14 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:37.879793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7bab8bfb-4f02-4217-88e4-af1cdd9b3d96 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:37.888649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7bab8bfb-4f02-4217-88e4-af1cdd9b3d96 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:37.890235 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7bab8bfb-4f02-4217-88e4-af1cdd9b3d96 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:37.891467 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7bab8bfb-4f02-4217-88e4-af1cdd9b3d96 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.296446 May 24 15:43:37.892353 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 346/648] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:37 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:37.944403 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ff25262e-ccd2-4940-b3ef-2e8f54bfde14 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:37.956996 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ff25262e-ccd2-4940-b3ef-2e8f54bfde14 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.253409 May 24 15:43:37.968064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 303/649] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:37 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:38.910342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e9c9d8b1-0128-4ab3-8ae2-8d83d1fad6d2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:38.910955 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e9c9d8b1-0128-4ab3-8ae2-8d83d1fad6d2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:38.918395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e9c9d8b1-0128-4ab3-8ae2-8d83d1fad6d2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:38.918933 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e9c9d8b1-0128-4ab3-8ae2-8d83d1fad6d2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:38.919756 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e9c9d8b1-0128-4ab3-8ae2-8d83d1fad6d2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:38.920333 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e9c9d8b1-0128-4ab3-8ae2-8d83d1fad6d2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:38.974615 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1291c2da-f921-46c8-adad-cfafd8ce4dd5 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:38.975208 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1291c2da-f921-46c8-adad-cfafd8ce4dd5 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:38.981855 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1291c2da-f921-46c8-adad-cfafd8ce4dd5 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:38.982299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1291c2da-f921-46c8-adad-cfafd8ce4dd5 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:38.983240 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1291c2da-f921-46c8-adad-cfafd8ce4dd5 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:38.983940 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1291c2da-f921-46c8-adad-cfafd8ce4dd5 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:39.102644 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e9c9d8b1-0128-4ab3-8ae2-8d83d1fad6d2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:39.112472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e9c9d8b1-0128-4ab3-8ae2-8d83d1fad6d2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:39.114142 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e9c9d8b1-0128-4ab3-8ae2-8d83d1fad6d2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:39.115457 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e9c9d8b1-0128-4ab3-8ae2-8d83d1fad6d2 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.209249 May 24 15:43:39.116121 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 347/650] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:38 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:43:39.157417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1291c2da-f921-46c8-adad-cfafd8ce4dd5 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:39.165637 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1291c2da-f921-46c8-adad-cfafd8ce4dd5 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.194899 May 24 15:43:39.166180 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 304/651] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:38 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:40.133714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cd6cce23-b32e-4aaf-beb5-7dddbccdac55 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:40.135101 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-cd6cce23-b32e-4aaf-beb5-7dddbccdac55 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:40.141882 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cd6cce23-b32e-4aaf-beb5-7dddbccdac55 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:40.142901 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cd6cce23-b32e-4aaf-beb5-7dddbccdac55 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:40.143827 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cd6cce23-b32e-4aaf-beb5-7dddbccdac55 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:40.144430 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cd6cce23-b32e-4aaf-beb5-7dddbccdac55 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:40.182629 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f18dbcce-a7ce-48c0-ab2e-951821708b31 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:40.183891 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f18dbcce-a7ce-48c0-ab2e-951821708b31 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:40.190602 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f18dbcce-a7ce-48c0-ab2e-951821708b31 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:40.191282 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f18dbcce-a7ce-48c0-ab2e-951821708b31 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:40.192161 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f18dbcce-a7ce-48c0-ab2e-951821708b31 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:40.192589 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f18dbcce-a7ce-48c0-ab2e-951821708b31 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:40.452666 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-cd6cce23-b32e-4aaf-beb5-7dddbccdac55 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:40.463984 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-cd6cce23-b32e-4aaf-beb5-7dddbccdac55 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:40.465823 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-cd6cce23-b32e-4aaf-beb5-7dddbccdac55 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:40.467013 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cd6cce23-b32e-4aaf-beb5-7dddbccdac55 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.337788 May 24 15:43:40.467572 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 348/652] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:40 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:40.472999 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-87b19e92-a578-419f-86c0-77f62a748e12 req-b8c9aaf3-be3f-48fe-9ccd-a15b01bbf73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b926408-71dd-454e-b9d3-7d4e0d12e270", "name": "network-vif-plugged", "status": "completed", "tag": "ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:40.482918 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-87b19e92-a578-419f-86c0-77f62a748e12 req-b8c9aaf3-be3f-48fe-9ccd-a15b01bbf73a service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:40.483361 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-87b19e92-a578-419f-86c0-77f62a748e12 req-b8c9aaf3-be3f-48fe-9ccd-a15b01bbf73a service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:40.487215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:40.496279 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-87b19e92-a578-419f-86c0-77f62a748e12 req-b8c9aaf3-be3f-48fe-9ccd-a15b01bbf73a service nova] Creating event network-vif-plugged:ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a for instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 on hv-cinder-84315 May 24 15:43:40.502065 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-87b19e92-a578-419f-86c0-77f62a748e12 req-b8c9aaf3-be3f-48fe-9ccd-a15b01bbf73a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 May 24 15:43:40.503229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 349/653] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:40.508413 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f18dbcce-a7ce-48c0-ab2e-951821708b31 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:40.519214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f18dbcce-a7ce-48c0-ab2e-951821708b31 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.340075 May 24 15:43:40.519887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 305/654] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:40 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:41.486451 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-17dd065c-1190-4a3a-977f-3cd5a0d5077b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:41.487797 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-17dd065c-1190-4a3a-977f-3cd5a0d5077b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:41.496709 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-17dd065c-1190-4a3a-977f-3cd5a0d5077b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:41.497126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-17dd065c-1190-4a3a-977f-3cd5a0d5077b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:41.497909 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-17dd065c-1190-4a3a-977f-3cd5a0d5077b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:41.498334 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-17dd065c-1190-4a3a-977f-3cd5a0d5077b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:41.538736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2adb79f0-0cb0-4cdb-99f2-47a9ce32cf8e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:41.539317 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2adb79f0-0cb0-4cdb-99f2-47a9ce32cf8e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:41.546244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2adb79f0-0cb0-4cdb-99f2-47a9ce32cf8e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:41.546902 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2adb79f0-0cb0-4cdb-99f2-47a9ce32cf8e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:41.547674 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2adb79f0-0cb0-4cdb-99f2-47a9ce32cf8e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:41.548115 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2adb79f0-0cb0-4cdb-99f2-47a9ce32cf8e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:41.798479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-17dd065c-1190-4a3a-977f-3cd5a0d5077b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:41.813873 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-17dd065c-1190-4a3a-977f-3cd5a0d5077b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:41.817165 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-17dd065c-1190-4a3a-977f-3cd5a0d5077b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:41.818696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-17dd065c-1190-4a3a-977f-3cd5a0d5077b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.336804 May 24 15:43:41.819244 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 350/655] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:41 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:41.840758 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2adb79f0-0cb0-4cdb-99f2-47a9ce32cf8e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:41.852714 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2adb79f0-0cb0-4cdb-99f2-47a9ce32cf8e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1359 microversion: 2.1 time: 0.317690 May 24 15:43:41.854306 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 306/656] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:41 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1359 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:42.838212 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-fd121b77-2fb3-4003-9464-7b3fc7d294af tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:42.838823 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-fd121b77-2fb3-4003-9464-7b3fc7d294af tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:42.847032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fd121b77-2fb3-4003-9464-7b3fc7d294af tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:42.847722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fd121b77-2fb3-4003-9464-7b3fc7d294af tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:42.848710 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fd121b77-2fb3-4003-9464-7b3fc7d294af tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:42.849307 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-fd121b77-2fb3-4003-9464-7b3fc7d294af tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:42.879765 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d24055b4-2e30-497d-8d59-5e9935243e49 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:42.882928 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d24055b4-2e30-497d-8d59-5e9935243e49 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:42.890910 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d24055b4-2e30-497d-8d59-5e9935243e49 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:42.892796 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d24055b4-2e30-497d-8d59-5e9935243e49 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:42.893913 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d24055b4-2e30-497d-8d59-5e9935243e49 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:42.894566 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d24055b4-2e30-497d-8d59-5e9935243e49 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:42.931388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=100 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:43.155990 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fd121b77-2fb3-4003-9464-7b3fc7d294af tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:43.176406 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fd121b77-2fb3-4003-9464-7b3fc7d294af tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:43.181871 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-fd121b77-2fb3-4003-9464-7b3fc7d294af tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:43.182602 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d24055b4-2e30-497d-8d59-5e9935243e49 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:43.183094 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-fd121b77-2fb3-4003-9464-7b3fc7d294af tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.349804 May 24 15:43:43.183823 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 351/657] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:42 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:43.194312 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d24055b4-2e30-497d-8d59-5e9935243e49 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1549 microversion: 2.1 time: 0.328090 May 24 15:43:43.194997 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 307/658] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:42 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1549 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:43.213953 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8f00bdcf-9c89-48ca-89a7-a619bdf8a096 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:43.215084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8f00bdcf-9c89-48ca-89a7-a619bdf8a096 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:43.222742 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8f00bdcf-9c89-48ca-89a7-a619bdf8a096 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:43.223459 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8f00bdcf-9c89-48ca-89a7-a619bdf8a096 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:43.224589 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8f00bdcf-9c89-48ca-89a7-a619bdf8a096 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:43.225347 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8f00bdcf-9c89-48ca-89a7-a619bdf8a096 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:43.447895 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8f00bdcf-9c89-48ca-89a7-a619bdf8a096 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:43.455546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8f00bdcf-9c89-48ca-89a7-a619bdf8a096 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1549 microversion: 2.1 time: 0.248290 May 24 15:43:43.456132 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 352/659] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:43 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1549 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:43.475637 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3551aed5-d4ea-475d-a3df-c844f902b7c9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:43.489871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-3551aed5-d4ea-475d-a3df-c844f902b7c9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:43.490676 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3551aed5-d4ea-475d-a3df-c844f902b7c9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Searching by: {'deleted': False, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee'} {{(pid=129339) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 24 15:43:43.497620 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3551aed5-d4ea-475d-a3df-c844f902b7c9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:43.498444 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3551aed5-d4ea-475d-a3df-c844f902b7c9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:43.499264 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3551aed5-d4ea-475d-a3df-c844f902b7c9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:43.499689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3551aed5-d4ea-475d-a3df-c844f902b7c9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:43.609716 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.multi_cell_list [None req-3551aed5-d4ea-475d-a3df-c844f902b7c9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129339) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 24 15:43:43.713148 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3551aed5-d4ea-475d-a3df-c844f902b7c9 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.242917 May 24 15:43:43.713779 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 308/660] 10.222.0.55 () {58 vars in 1124 bytes} [Tue May 24 15:43:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:43.724897 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4bd3e184-86f3-4976-a693-16d1056d2c52 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:43.726487 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-4bd3e184-86f3-4976-a693-16d1056d2c52 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:43.732781 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4bd3e184-86f3-4976-a693-16d1056d2c52 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:43.733484 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4bd3e184-86f3-4976-a693-16d1056d2c52 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:43.734247 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4bd3e184-86f3-4976-a693-16d1056d2c52 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:43.734669 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4bd3e184-86f3-4976-a693-16d1056d2c52 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:43.941144 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-4bd3e184-86f3-4976-a693-16d1056d2c52 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:43.953280 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-4bd3e184-86f3-4976-a693-16d1056d2c52 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1549 microversion: 2.1 time: 0.233071 May 24 15:43:43.953869 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 353/661] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:43 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1549 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:44.203564 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b3252373-b855-4e86-b233-aa72aef1c9e4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:44.204237 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b3252373-b855-4e86-b233-aa72aef1c9e4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:44.212587 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b3252373-b855-4e86-b233-aa72aef1c9e4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:44.216819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b3252373-b855-4e86-b233-aa72aef1c9e4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:44.218249 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b3252373-b855-4e86-b233-aa72aef1c9e4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:44.218695 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b3252373-b855-4e86-b233-aa72aef1c9e4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:44.285712 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5c6853b2-aa41-471b-a4c2-b728cce94b4d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'create', calling method: .version_select at 0x7fb1d51cf4c0>, body: {"keypair": {"name": "tempest-keypair-402252766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPYLuSaJMenguUDiVl34ZKUUNr/cE3lRkwEAeC0fEP9USdLd4w1oz41K+Vyjqq9DsxQ6Qi/Omk8QusMv2re50V8Am6BrcpYzFn5XrHk/6zKbkvIghTQINc0FUKHNCSwgA=="}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:44.322062 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-5c6853b2-aa41-471b-a4c2-b728cce94b4d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Getting quotas for project f92c7d44a8de4b2ab85ab081276300fd. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:43:44.326825 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-5c6853b2-aa41-471b-a4c2-b728cce94b4d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Getting quotas for user ad8f617cb0b14532b3ad514a0430e54f and project f92c7d44a8de4b2ab85ab081276300fd. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:43:44.355588 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5c6853b2-aa41-471b-a4c2-b728cce94b4d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.241396 May 24 15:43:44.356908 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 309/662] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 24 15:43:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:44.411216 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b3252373-b855-4e86-b233-aa72aef1c9e4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:44.421440 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b3252373-b855-4e86-b233-aa72aef1c9e4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:44.423443 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b3252373-b855-4e86-b233-aa72aef1c9e4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:44.424673 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b3252373-b855-4e86-b233-aa72aef1c9e4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.226533 May 24 15:43:44.425237 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 354/663] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:44 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:45.444002 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d01a02d1-c8f5-4903-b7a8-de297eadfe4b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:45.444726 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d01a02d1-c8f5-4903-b7a8-de297eadfe4b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:45.464220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d01a02d1-c8f5-4903-b7a8-de297eadfe4b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:45.464894 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d01a02d1-c8f5-4903-b7a8-de297eadfe4b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:45.465756 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d01a02d1-c8f5-4903-b7a8-de297eadfe4b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:45.466199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d01a02d1-c8f5-4903-b7a8-de297eadfe4b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:45.600263 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-96d98c67-65fa-4351-a252-64787197f01c tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e38ed2a-33b7-43d2-982c-08dbd571e226"}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:45.602881 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-96d98c67-65fa-4351-a252-64787197f01c tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:45.611624 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96d98c67-65fa-4351-a252-64787197f01c tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:45.612424 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96d98c67-65fa-4351-a252-64787197f01c tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:45.613390 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96d98c67-65fa-4351-a252-64787197f01c tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:45.613985 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96d98c67-65fa-4351-a252-64787197f01c tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:45.623332 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d01a02d1-c8f5-4903-b7a8-de297eadfe4b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:45.633387 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d01a02d1-c8f5-4903-b7a8-de297eadfe4b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:45.634941 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d01a02d1-c8f5-4903-b7a8-de297eadfe4b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:45.637032 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d01a02d1-c8f5-4903-b7a8-de297eadfe4b tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.197263 May 24 15:43:45.638186 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 310/664] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:45 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:45.965008 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-96d98c67-65fa-4351-a252-64787197f01c tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "POST /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368645 May 24 15:43:45.966092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 355/665] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:43:45 2022] POST /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:45.995913 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-492938223", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0609c63-82a5-45e5-be15-292af1dcfb75"}], "security_groups": [{"name": "tempest-securitygroup--1336420326"}], "key_name": "tempest-keypair-402252766", "user_data": "}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:46.138208 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] validate_networks() for [('a0609c63-82a5-45e5-be15-292af1dcfb75', None, None, None, None, None)] {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:43:46.618070 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:43:46.618692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:43:46.619652 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:43:46.620060 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:43:46.620483 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:43:46.630271 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:46.630610 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:46.632144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:46.632675 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:46.653488 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Getting quotas for project f92c7d44a8de4b2ab85ab081276300fd. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:43:46.657886 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Getting quotas for user ad8f617cb0b14532b3ad514a0430e54f and project f92c7d44a8de4b2ab85ab081276300fd. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:43:46.669106 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1cafaa7a-fedd-4683-9dcd-9a16de4e2571 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:46.669622 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:43:46.672324 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:43:46.672928 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1cafaa7a-fedd-4683-9dcd-9a16de4e2571 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:46.694400 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1cafaa7a-fedd-4683-9dcd-9a16de4e2571 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:46.695728 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1cafaa7a-fedd-4683-9dcd-9a16de4e2571 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:46.696554 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1cafaa7a-fedd-4683-9dcd-9a16de4e2571 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:46.696984 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1cafaa7a-fedd-4683-9dcd-9a16de4e2571 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:46.728520 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-8570fc5e-be7b-4689-ba4a-f87cc914d1b7 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.737092 May 24 15:43:46.735441 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 311/666] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:43:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:43:46.742243 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d6785b9e-a4b1-49f4-9be6-7fe043a6b6d9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:46.743126 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d6785b9e-a4b1-49f4-9be6-7fe043a6b6d9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:46.822862 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d6785b9e-a4b1-49f4-9be6-7fe043a6b6d9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:46.832761 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d6785b9e-a4b1-49f4-9be6-7fe043a6b6d9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1236 microversion: 2.1 time: 0.094749 May 24 15:43:46.841074 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 312/667] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:46 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:46.933841 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1cafaa7a-fedd-4683-9dcd-9a16de4e2571 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:46.942464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1cafaa7a-fedd-4683-9dcd-9a16de4e2571 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:46.944319 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-1cafaa7a-fedd-4683-9dcd-9a16de4e2571 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:46.945580 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1cafaa7a-fedd-4683-9dcd-9a16de4e2571 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.289792 May 24 15:43:46.951143 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 356/668] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:46 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:47.857882 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-54c772fb-2973-4515-86dc-063976cfa30d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:47.862720 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-54c772fb-2973-4515-86dc-063976cfa30d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:47.869842 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-54c772fb-2973-4515-86dc-063976cfa30d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:47.870360 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-54c772fb-2973-4515-86dc-063976cfa30d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:47.871195 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-54c772fb-2973-4515-86dc-063976cfa30d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:47.871693 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-54c772fb-2973-4515-86dc-063976cfa30d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:47.952679 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-54c772fb-2973-4515-86dc-063976cfa30d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:47.961439 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-54c772fb-2973-4515-86dc-063976cfa30d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1296 microversion: 2.1 time: 0.107396 May 24 15:43:47.962084 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 313/669] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:47 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:47.965826 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b8d534a1-b1b2-4854-9a57-3e3b4fc83278 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:47.966431 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b8d534a1-b1b2-4854-9a57-3e3b4fc83278 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:47.972869 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b8d534a1-b1b2-4854-9a57-3e3b4fc83278 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:47.973509 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b8d534a1-b1b2-4854-9a57-3e3b4fc83278 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:47.974706 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b8d534a1-b1b2-4854-9a57-3e3b4fc83278 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:47.975172 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b8d534a1-b1b2-4854-9a57-3e3b4fc83278 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:48.113735 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b8d534a1-b1b2-4854-9a57-3e3b4fc83278 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:48.123494 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b8d534a1-b1b2-4854-9a57-3e3b4fc83278 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:48.125022 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b8d534a1-b1b2-4854-9a57-3e3b4fc83278 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:48.126185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b8d534a1-b1b2-4854-9a57-3e3b4fc83278 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.164885 May 24 15:43:48.126885 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 357/670] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:47 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:48.978962 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3c71977a-32ec-448f-9fc0-b3734bbc98af tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:48.979582 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3c71977a-32ec-448f-9fc0-b3734bbc98af tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:48.986546 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3c71977a-32ec-448f-9fc0-b3734bbc98af tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:48.986989 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3c71977a-32ec-448f-9fc0-b3734bbc98af tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:48.987751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3c71977a-32ec-448f-9fc0-b3734bbc98af tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:48.988254 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3c71977a-32ec-448f-9fc0-b3734bbc98af tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:49.118918 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-3c71977a-32ec-448f-9fc0-b3734bbc98af tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:49.126761 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3c71977a-32ec-448f-9fc0-b3734bbc98af tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1362 microversion: 2.1 time: 0.151763 May 24 15:43:49.127343 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 314/671] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:48 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:49.145181 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-db942f34-8b0c-4a58-b646-6748f2eeb6c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:49.146237 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-db942f34-8b0c-4a58-b646-6748f2eeb6c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:49.153232 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-db942f34-8b0c-4a58-b646-6748f2eeb6c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:49.153743 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-db942f34-8b0c-4a58-b646-6748f2eeb6c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:49.154572 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-db942f34-8b0c-4a58-b646-6748f2eeb6c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:49.155003 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-db942f34-8b0c-4a58-b646-6748f2eeb6c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:49.322102 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-db942f34-8b0c-4a58-b646-6748f2eeb6c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:49.330792 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-db942f34-8b0c-4a58-b646-6748f2eeb6c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:49.332999 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-db942f34-8b0c-4a58-b646-6748f2eeb6c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:49.334990 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-db942f34-8b0c-4a58-b646-6748f2eeb6c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1742 microversion: 2.20 time: 0.194189 May 24 15:43:49.335717 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 358/672] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:49 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1742 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:49.466336 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-c1c997ba-37bf-4ee6-949e-49b2ef5af8e4 req-717577ad-f271-4f54-a5a1-eba9b635f60d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38", "tag": "fd56e978-8417-4a9e-9877-8bfb981aa335"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:49.477883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-c1c997ba-37bf-4ee6-949e-49b2ef5af8e4 req-717577ad-f271-4f54-a5a1-eba9b635f60d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:49.478648 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-c1c997ba-37bf-4ee6-949e-49b2ef5af8e4 req-717577ad-f271-4f54-a5a1-eba9b635f60d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:49.497765 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-c1c997ba-37bf-4ee6-949e-49b2ef5af8e4 req-717577ad-f271-4f54-a5a1-eba9b635f60d service nova] Creating event network-changed:fd56e978-8417-4a9e-9877-8bfb981aa335 for instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 on hv-cinder-84315 May 24 15:43:49.502986 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-c1c997ba-37bf-4ee6-949e-49b2ef5af8e4 req-717577ad-f271-4f54-a5a1-eba9b635f60d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109718 May 24 15:43:49.503588 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 315/673] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:50.147178 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-35819a51-1a44-468b-be4c-e23a77587c30 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:50.147829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-35819a51-1a44-468b-be4c-e23a77587c30 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:50.154831 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-35819a51-1a44-468b-be4c-e23a77587c30 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:50.155273 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-35819a51-1a44-468b-be4c-e23a77587c30 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:50.156055 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-35819a51-1a44-468b-be4c-e23a77587c30 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:50.156498 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-35819a51-1a44-468b-be4c-e23a77587c30 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:50.291506 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-35819a51-1a44-468b-be4c-e23a77587c30 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:50.299453 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-35819a51-1a44-468b-be4c-e23a77587c30 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1362 microversion: 2.1 time: 0.158703 May 24 15:43:50.300020 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 359/674] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:50 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:50.355499 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-07af3063-c695-4bfd-ae5e-f61ce239502c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:50.356314 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-07af3063-c695-4bfd-ae5e-f61ce239502c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:50.363494 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07af3063-c695-4bfd-ae5e-f61ce239502c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:50.363928 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07af3063-c695-4bfd-ae5e-f61ce239502c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:50.364887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07af3063-c695-4bfd-ae5e-f61ce239502c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:50.365310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-07af3063-c695-4bfd-ae5e-f61ce239502c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:50.670608 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-07af3063-c695-4bfd-ae5e-f61ce239502c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:50.679018 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-07af3063-c695-4bfd-ae5e-f61ce239502c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:50.680550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-07af3063-c695-4bfd-ae5e-f61ce239502c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:50.681733 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-07af3063-c695-4bfd-ae5e-f61ce239502c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1742 microversion: 2.20 time: 0.330485 May 24 15:43:50.682287 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 316/675] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:50 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1742 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:51.316822 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-eedbbb5b-8aa1-4cab-ab3b-1d5427c4edac tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:51.317477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-eedbbb5b-8aa1-4cab-ab3b-1d5427c4edac tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:51.324213 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eedbbb5b-8aa1-4cab-ab3b-1d5427c4edac tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:51.324682 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eedbbb5b-8aa1-4cab-ab3b-1d5427c4edac tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:51.325435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eedbbb5b-8aa1-4cab-ab3b-1d5427c4edac tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:51.325874 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eedbbb5b-8aa1-4cab-ab3b-1d5427c4edac tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:51.456731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-eedbbb5b-8aa1-4cab-ab3b-1d5427c4edac tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:51.464340 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-eedbbb5b-8aa1-4cab-ab3b-1d5427c4edac tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1362 microversion: 2.1 time: 0.151371 May 24 15:43:51.464912 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 360/676] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:51 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:51.700281 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d6f1a36c-1747-4a1e-a6a6-333d1138391e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:51.700879 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d6f1a36c-1747-4a1e-a6a6-333d1138391e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:51.707428 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d6f1a36c-1747-4a1e-a6a6-333d1138391e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:51.707868 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d6f1a36c-1747-4a1e-a6a6-333d1138391e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:51.708862 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d6f1a36c-1747-4a1e-a6a6-333d1138391e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:51.709186 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d6f1a36c-1747-4a1e-a6a6-333d1138391e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:51.867115 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d6f1a36c-1747-4a1e-a6a6-333d1138391e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:51.876180 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d6f1a36c-1747-4a1e-a6a6-333d1138391e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:51.877830 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d6f1a36c-1747-4a1e-a6a6-333d1138391e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:51.879418 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d6f1a36c-1747-4a1e-a6a6-333d1138391e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1737 microversion: 2.20 time: 0.183161 May 24 15:43:51.880594 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 317/677] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:51 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:52.485720 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-098802cd-f26e-4eff-bbb7-d4ff8f3c3882 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:52.487272 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-098802cd-f26e-4eff-bbb7-d4ff8f3c3882 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:52.495363 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-098802cd-f26e-4eff-bbb7-d4ff8f3c3882 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:52.502342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-098802cd-f26e-4eff-bbb7-d4ff8f3c3882 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:52.504156 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-098802cd-f26e-4eff-bbb7-d4ff8f3c3882 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:52.504829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-098802cd-f26e-4eff-bbb7-d4ff8f3c3882 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:52.710471 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-098802cd-f26e-4eff-bbb7-d4ff8f3c3882 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:52.719846 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-098802cd-f26e-4eff-bbb7-d4ff8f3c3882 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1362 microversion: 2.1 time: 0.239636 May 24 15:43:52.721382 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 361/678] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:52 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:52.901649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b5c3e346-db19-4a64-a0e8-37cfd2fee8d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:52.902438 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b5c3e346-db19-4a64-a0e8-37cfd2fee8d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:52.909920 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b5c3e346-db19-4a64-a0e8-37cfd2fee8d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:52.910476 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b5c3e346-db19-4a64-a0e8-37cfd2fee8d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:52.911577 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b5c3e346-db19-4a64-a0e8-37cfd2fee8d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:52.911791 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b5c3e346-db19-4a64-a0e8-37cfd2fee8d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:53.063008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b5c3e346-db19-4a64-a0e8-37cfd2fee8d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:53.071505 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b5c3e346-db19-4a64-a0e8-37cfd2fee8d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:53.073271 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b5c3e346-db19-4a64-a0e8-37cfd2fee8d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:53.074633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b5c3e346-db19-4a64-a0e8-37cfd2fee8d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1737 microversion: 2.20 time: 0.177525 May 24 15:43:53.075370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 318/679] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:52 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:53.637612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a302a2de-f41c-4e75-95a1-f3dee84e09c4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:53.638222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a302a2de-f41c-4e75-95a1-f3dee84e09c4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:53.645449 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a302a2de-f41c-4e75-95a1-f3dee84e09c4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:53.646212 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a302a2de-f41c-4e75-95a1-f3dee84e09c4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:53.647166 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a302a2de-f41c-4e75-95a1-f3dee84e09c4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:53.647598 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a302a2de-f41c-4e75-95a1-f3dee84e09c4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:53.741579 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e0f5001e-3c06-4713-a934-42716905901c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:53.742456 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e0f5001e-3c06-4713-a934-42716905901c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:53.750689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0f5001e-3c06-4713-a934-42716905901c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:53.751793 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0f5001e-3c06-4713-a934-42716905901c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:53.752876 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0f5001e-3c06-4713-a934-42716905901c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:53.753493 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0f5001e-3c06-4713-a934-42716905901c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:53.815765 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a302a2de-f41c-4e75-95a1-f3dee84e09c4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:53.825473 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a302a2de-f41c-4e75-95a1-f3dee84e09c4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1595 microversion: 2.1 time: 0.191635 May 24 15:43:53.826607 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 362/680] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:53 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1595 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:53.936126 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e0f5001e-3c06-4713-a934-42716905901c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:53.947266 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e0f5001e-3c06-4713-a934-42716905901c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1362 microversion: 2.1 time: 0.210225 May 24 15:43:53.948219 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 319/681] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:53 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:54.093617 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-68fb846b-6aa0-4f6d-a203-03151b7fe2d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:54.094331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-68fb846b-6aa0-4f6d-a203-03151b7fe2d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:54.110456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68fb846b-6aa0-4f6d-a203-03151b7fe2d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:54.111013 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68fb846b-6aa0-4f6d-a203-03151b7fe2d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:54.111858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68fb846b-6aa0-4f6d-a203-03151b7fe2d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:54.112372 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-68fb846b-6aa0-4f6d-a203-03151b7fe2d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:54.440539 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-eab3a9f0-53b5-4807-95ce-800db9a8c20f req-d7a8388e-5658-4b9a-9bc1-f7cbbe8d101d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a52505-bbe8-48c0-ba6f-ec99a6980285", "name": "network-vif-plugged", "status": "completed", "tag": "f0b68296-7928-4ede-98e0-8adf6abeff09"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:54.462252 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-eab3a9f0-53b5-4807-95ce-800db9a8c20f req-d7a8388e-5658-4b9a-9bc1-f7cbbe8d101d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:54.463036 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-eab3a9f0-53b5-4807-95ce-800db9a8c20f req-d7a8388e-5658-4b9a-9bc1-f7cbbe8d101d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:54.480645 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-eab3a9f0-53b5-4807-95ce-800db9a8c20f req-d7a8388e-5658-4b9a-9bc1-f7cbbe8d101d service nova] Creating event network-vif-plugged:f0b68296-7928-4ede-98e0-8adf6abeff09 for instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 on hv-cinder-84315 May 24 15:43:54.486543 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-eab3a9f0-53b5-4807-95ce-800db9a8c20f req-d7a8388e-5658-4b9a-9bc1-f7cbbe8d101d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140825 May 24 15:43:54.487978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 320/682] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:54.728357 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-68fb846b-6aa0-4f6d-a203-03151b7fe2d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:54.737255 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-68fb846b-6aa0-4f6d-a203-03151b7fe2d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:54.738803 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-68fb846b-6aa0-4f6d-a203-03151b7fe2d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:54.740162 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-68fb846b-6aa0-4f6d-a203-03151b7fe2d9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1737 microversion: 2.20 time: 0.650547 May 24 15:43:54.748128 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 363/683] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:54 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1737 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:54.965654 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c2a9f28a-f711-4a60-8447-b23a3b275187 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:54.968324 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c2a9f28a-f711-4a60-8447-b23a3b275187 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:54.978601 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c2a9f28a-f711-4a60-8447-b23a3b275187 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:54.979299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c2a9f28a-f711-4a60-8447-b23a3b275187 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:54.980342 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c2a9f28a-f711-4a60-8447-b23a3b275187 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:54.980999 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c2a9f28a-f711-4a60-8447-b23a3b275187 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:55.238463 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c2a9f28a-f711-4a60-8447-b23a3b275187 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:55.251226 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c2a9f28a-f711-4a60-8447-b23a3b275187 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1362 microversion: 2.1 time: 0.289871 May 24 15:43:55.252110 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 321/684] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:54 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:55.759113 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ee789ad9-9301-40fa-b492-40869f75a9cd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:55.759774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ee789ad9-9301-40fa-b492-40869f75a9cd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:55.767222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ee789ad9-9301-40fa-b492-40869f75a9cd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:55.768262 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ee789ad9-9301-40fa-b492-40869f75a9cd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:55.769287 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ee789ad9-9301-40fa-b492-40869f75a9cd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:55.770017 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ee789ad9-9301-40fa-b492-40869f75a9cd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:56.028453 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ee789ad9-9301-40fa-b492-40869f75a9cd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:56.045228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ee789ad9-9301-40fa-b492-40869f75a9cd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:56.047175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ee789ad9-9301-40fa-b492-40869f75a9cd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:56.048658 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ee789ad9-9301-40fa-b492-40869f75a9cd tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1737 microversion: 2.20 time: 0.294469 May 24 15:43:56.049996 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 364/685] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:55 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1737 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:43:56.269106 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-eec2c7b0-0f86-4848-a048-dde1f6d4b22e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:56.270944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-eec2c7b0-0f86-4848-a048-dde1f6d4b22e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:56.285247 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eec2c7b0-0f86-4848-a048-dde1f6d4b22e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:56.286084 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eec2c7b0-0f86-4848-a048-dde1f6d4b22e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:56.286806 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eec2c7b0-0f86-4848-a048-dde1f6d4b22e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:56.287420 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-eec2c7b0-0f86-4848-a048-dde1f6d4b22e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:56.513322 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-eec2c7b0-0f86-4848-a048-dde1f6d4b22e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:56.526591 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-eec2c7b0-0f86-4848-a048-dde1f6d4b22e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1362 microversion: 2.1 time: 0.261705 May 24 15:43:56.527574 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 322/686] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:56 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:56.652251 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-2b78b261-0c07-4598-9477-aa4fc3465543 req-f109239c-8e0d-4a79-b728-beb30b6385f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38", "name": "network-vif-plugged", "status": "completed", "tag": "fd56e978-8417-4a9e-9877-8bfb981aa335"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:56.665739 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=4 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:56.672193 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-2b78b261-0c07-4598-9477-aa4fc3465543 req-f109239c-8e0d-4a79-b728-beb30b6385f1 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:56.672648 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-2b78b261-0c07-4598-9477-aa4fc3465543 req-f109239c-8e0d-4a79-b728-beb30b6385f1 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:56.702571 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-2b78b261-0c07-4598-9477-aa4fc3465543 req-f109239c-8e0d-4a79-b728-beb30b6385f1 service nova] Creating event network-vif-plugged:fd56e978-8417-4a9e-9877-8bfb981aa335 for instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 on hv-cinder-84315 May 24 15:43:56.715908 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-2b78b261-0c07-4598-9477-aa4fc3465543 req-f109239c-8e0d-4a79-b728-beb30b6385f1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067464 May 24 15:43:56.717149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 323/687] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:43:56.731537 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-67b22613-9c68-48e1-a1c9-7e7f0248a40a req-2e1ad47a-ff51-488a-94b6-63985d6f18db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b926408-71dd-454e-b9d3-7d4e0d12e270", "tag": "ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:56.764678 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-67b22613-9c68-48e1-a1c9-7e7f0248a40a req-2e1ad47a-ff51-488a-94b6-63985d6f18db service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:56.765965 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-67b22613-9c68-48e1-a1c9-7e7f0248a40a req-2e1ad47a-ff51-488a-94b6-63985d6f18db service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:56.786432 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:56.799100 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-67b22613-9c68-48e1-a1c9-7e7f0248a40a req-2e1ad47a-ff51-488a-94b6-63985d6f18db service nova] Creating event network-changed:ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a for instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 on hv-cinder-84315 May 24 15:43:56.810900 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-67b22613-9c68-48e1-a1c9-7e7f0248a40a req-2e1ad47a-ff51-488a-94b6-63985d6f18db service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214836 May 24 15:43:56.813157 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 365/688] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:57.064008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=12 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:43:57.069193 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d998fa07-dd9f-4eda-b9bc-7d08217b8b1f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:57.069931 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d998fa07-dd9f-4eda-b9bc-7d08217b8b1f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:57.080460 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d998fa07-dd9f-4eda-b9bc-7d08217b8b1f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:57.083404 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d998fa07-dd9f-4eda-b9bc-7d08217b8b1f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:57.084459 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d998fa07-dd9f-4eda-b9bc-7d08217b8b1f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:57.087089 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d998fa07-dd9f-4eda-b9bc-7d08217b8b1f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:57.364605 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d998fa07-dd9f-4eda-b9bc-7d08217b8b1f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:57.384803 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d998fa07-dd9f-4eda-b9bc-7d08217b8b1f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:57.389229 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d998fa07-dd9f-4eda-b9bc-7d08217b8b1f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:57.394764 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d998fa07-dd9f-4eda-b9bc-7d08217b8b1f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1737 microversion: 2.20 time: 0.331677 May 24 15:43:57.395633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 324/689] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:57 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1737 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:57.555308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-041edbbb-d61d-45d4-87a7-0e076a18dedd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:57.556518 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-041edbbb-d61d-45d4-87a7-0e076a18dedd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:57.571450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-041edbbb-d61d-45d4-87a7-0e076a18dedd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:57.571883 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-041edbbb-d61d-45d4-87a7-0e076a18dedd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:57.576888 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-041edbbb-d61d-45d4-87a7-0e076a18dedd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:57.577080 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-041edbbb-d61d-45d4-87a7-0e076a18dedd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:57.816201 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-041edbbb-d61d-45d4-87a7-0e076a18dedd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:57.842656 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-041edbbb-d61d-45d4-87a7-0e076a18dedd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1362 microversion: 2.1 time: 0.293887 May 24 15:43:57.848219 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 366/690] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:57 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:43:58.388965 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b2ec66d2-9bcb-4dfb-b4f3-cf6fbc289b37 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2083163814"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:58.389503 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b2ec66d2-9bcb-4dfb-b4f3-cf6fbc289b37 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:58.398589 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b2ec66d2-9bcb-4dfb-b4f3-cf6fbc289b37 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:58.399450 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b2ec66d2-9bcb-4dfb-b4f3-cf6fbc289b37 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:58.401171 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b2ec66d2-9bcb-4dfb-b4f3-cf6fbc289b37 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:58.402316 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b2ec66d2-9bcb-4dfb-b4f3-cf6fbc289b37 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:58.413560 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7899bbd1-12ef-4ea3-9923-a27f54a3f7e8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:58.414312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7899bbd1-12ef-4ea3-9923-a27f54a3f7e8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:58.424140 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7899bbd1-12ef-4ea3-9923-a27f54a3f7e8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:58.424726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7899bbd1-12ef-4ea3-9923-a27f54a3f7e8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:58.425603 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7899bbd1-12ef-4ea3-9923-a27f54a3f7e8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:58.428565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7899bbd1-12ef-4ea3-9923-a27f54a3f7e8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:58.605196 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.network.security_group_api [None req-b2ec66d2-9bcb-4dfb-b4f3-cf6fbc289b37 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Adding security group 04b37776-5d25-409b-a268-a2a5076f4cab to port ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a May 24 15:43:58.724860 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7899bbd1-12ef-4ea3-9923-a27f54a3f7e8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:58.745344 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7899bbd1-12ef-4ea3-9923-a27f54a3f7e8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:58.749563 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7899bbd1-12ef-4ea3-9923-a27f54a3f7e8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:58.754412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7899bbd1-12ef-4ea3-9923-a27f54a3f7e8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1737 microversion: 2.20 time: 0.344857 May 24 15:43:58.756388 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 367/691] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:58 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1737 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:43:58.865041 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-affac755-71ef-46d6-9090-69a632b23212 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:58.866486 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-affac755-71ef-46d6-9090-69a632b23212 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:58.875958 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-affac755-71ef-46d6-9090-69a632b23212 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:58.879600 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-affac755-71ef-46d6-9090-69a632b23212 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:58.881585 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-affac755-71ef-46d6-9090-69a632b23212 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:58.882446 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-affac755-71ef-46d6-9090-69a632b23212 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.137793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-affac755-71ef-46d6-9090-69a632b23212 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:59.148587 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-affac755-71ef-46d6-9090-69a632b23212 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1548 microversion: 2.1 time: 0.288966 May 24 15:43:59.149264 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 368/692] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:58 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1548 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:59.165185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4d7fad18-2523-441c-b222-c95c1c9d78b4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:59.165907 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-4d7fad18-2523-441c-b222-c95c1c9d78b4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:59.174009 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4d7fad18-2523-441c-b222-c95c1c9d78b4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.174499 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4d7fad18-2523-441c-b222-c95c1c9d78b4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.175331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4d7fad18-2523-441c-b222-c95c1c9d78b4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.175842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4d7fad18-2523-441c-b222-c95c1c9d78b4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.304082 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b2ec66d2-9bcb-4dfb-b4f3-cf6fbc289b37 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "POST /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/action" status: 202 len: 0 microversion: 2.1 time: 0.919505 May 24 15:43:59.305010 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 325/693] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:43:58 2022] POST /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/action => generated 0 bytes in 921 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:43:59.313304 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0ba2a367-40d8-4158-8326-90f111a6090b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:59.314299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0ba2a367-40d8-4158-8326-90f111a6090b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:59.343885 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0ba2a367-40d8-4158-8326-90f111a6090b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.344627 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0ba2a367-40d8-4158-8326-90f111a6090b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.345592 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0ba2a367-40d8-4158-8326-90f111a6090b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.347107 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0ba2a367-40d8-4158-8326-90f111a6090b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.349489 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-4d7fad18-2523-441c-b222-c95c1c9d78b4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188282 May 24 15:43:59.361434 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 369/694] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 24 15:43:59 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:59.373232 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-6921ccdc-d9d7-4098-9dea-af1dc8b2d15d req-f2a5e4de-dd51-4ed3-b8f4-64442a385b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b926408-71dd-454e-b9d3-7d4e0d12e270", "tag": "ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:43:59.392241 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-6921ccdc-d9d7-4098-9dea-af1dc8b2d15d req-f2a5e4de-dd51-4ed3-b8f4-64442a385b74 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.392693 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-6921ccdc-d9d7-4098-9dea-af1dc8b2d15d req-f2a5e4de-dd51-4ed3-b8f4-64442a385b74 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.436917 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-6921ccdc-d9d7-4098-9dea-af1dc8b2d15d req-f2a5e4de-dd51-4ed3-b8f4-64442a385b74 service nova] Creating event network-changed:ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a for instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 on hv-cinder-84315 May 24 15:43:59.446037 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-6921ccdc-d9d7-4098-9dea-af1dc8b2d15d req-f2a5e4de-dd51-4ed3-b8f4-64442a385b74 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079738 May 24 15:43:59.447935 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 370/695] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:43:59.625147 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0ba2a367-40d8-4158-8326-90f111a6090b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:59.639903 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0ba2a367-40d8-4158-8326-90f111a6090b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1760 microversion: 2.1 time: 0.330493 May 24 15:43:59.649478 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 326/696] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:43:59 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1760 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:43:59.775994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a75dd8f5-8d08-42fd-a888-aaa9510319b4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:43:59.777156 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a75dd8f5-8d08-42fd-a888-aaa9510319b4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:43:59.784420 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a75dd8f5-8d08-42fd-a888-aaa9510319b4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.785194 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a75dd8f5-8d08-42fd-a888-aaa9510319b4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.786667 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a75dd8f5-8d08-42fd-a888-aaa9510319b4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:43:59.787317 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a75dd8f5-8d08-42fd-a888-aaa9510319b4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:43:59.957573 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a75dd8f5-8d08-42fd-a888-aaa9510319b4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:59.969921 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a75dd8f5-8d08-42fd-a888-aaa9510319b4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:59.972441 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a75dd8f5-8d08-42fd-a888-aaa9510319b4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:43:59.975954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a75dd8f5-8d08-42fd-a888-aaa9510319b4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1737 microversion: 2.20 time: 0.206646 May 24 15:43:59.979348 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 371/697] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:43:59 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:00.996360 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1cf41146-9697-469c-b8be-ea0d13beaba0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:00.996966 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1cf41146-9697-469c-b8be-ea0d13beaba0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:01.003746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1cf41146-9697-469c-b8be-ea0d13beaba0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:01.004227 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1cf41146-9697-469c-b8be-ea0d13beaba0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:01.005075 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1cf41146-9697-469c-b8be-ea0d13beaba0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:01.005504 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1cf41146-9697-469c-b8be-ea0d13beaba0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:01.177443 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1cf41146-9697-469c-b8be-ea0d13beaba0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:01.188355 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1cf41146-9697-469c-b8be-ea0d13beaba0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:01.191071 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1cf41146-9697-469c-b8be-ea0d13beaba0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:01.192653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1cf41146-9697-469c-b8be-ea0d13beaba0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1737 microversion: 2.20 time: 0.200318 May 24 15:44:01.203617 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 327/698] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:00 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:01.255082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-2dfc4c6f-5782-4dd3-a61d-cf782136555b req-a78e2481-d3b0-4377-a8d8-46584c25da69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38", "tag": "fd56e978-8417-4a9e-9877-8bfb981aa335"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:01.264146 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-2dfc4c6f-5782-4dd3-a61d-cf782136555b req-a78e2481-d3b0-4377-a8d8-46584c25da69 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:01.264834 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-2dfc4c6f-5782-4dd3-a61d-cf782136555b req-a78e2481-d3b0-4377-a8d8-46584c25da69 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:01.277769 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-2dfc4c6f-5782-4dd3-a61d-cf782136555b req-a78e2481-d3b0-4377-a8d8-46584c25da69 service nova] Creating event network-changed:fd56e978-8417-4a9e-9877-8bfb981aa335 for instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 on hv-cinder-84315 May 24 15:44:01.284650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-2dfc4c6f-5782-4dd3-a61d-cf782136555b req-a78e2481-d3b0-4377-a8d8-46584c25da69 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033075 May 24 15:44:01.285865 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 372/699] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:02.211326 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d22af953-cffd-43db-822a-52fdf0896c5d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:02.212763 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d22af953-cffd-43db-822a-52fdf0896c5d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:02.220561 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d22af953-cffd-43db-822a-52fdf0896c5d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:02.221014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d22af953-cffd-43db-822a-52fdf0896c5d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:02.221783 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d22af953-cffd-43db-822a-52fdf0896c5d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:02.223098 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d22af953-cffd-43db-822a-52fdf0896c5d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:02.241995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=100 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:02.397328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d22af953-cffd-43db-822a-52fdf0896c5d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:02.409549 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d22af953-cffd-43db-822a-52fdf0896c5d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:02.411242 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d22af953-cffd-43db-822a-52fdf0896c5d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:02.412403 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d22af953-cffd-43db-822a-52fdf0896c5d tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1737 microversion: 2.20 time: 0.205433 May 24 15:44:02.412991 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 328/700] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:02 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:03.433129 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ada36b74-7c23-4ffb-905b-f5b2a8ea1fa8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:03.433951 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ada36b74-7c23-4ffb-905b-f5b2a8ea1fa8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:03.441257 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ada36b74-7c23-4ffb-905b-f5b2a8ea1fa8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:03.441696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ada36b74-7c23-4ffb-905b-f5b2a8ea1fa8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:03.442455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ada36b74-7c23-4ffb-905b-f5b2a8ea1fa8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:03.442984 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ada36b74-7c23-4ffb-905b-f5b2a8ea1fa8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:03.581092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ada36b74-7c23-4ffb-905b-f5b2a8ea1fa8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:03.589192 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ada36b74-7c23-4ffb-905b-f5b2a8ea1fa8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:03.590687 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ada36b74-7c23-4ffb-905b-f5b2a8ea1fa8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:03.591885 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ada36b74-7c23-4ffb-905b-f5b2a8ea1fa8 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1719 microversion: 2.20 time: 0.163560 May 24 15:44:03.592508 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 373/701] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:03 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:04.614333 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a157e85e-50d5-41d8-86b0-cc3258bea5de tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:04.615350 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a157e85e-50d5-41d8-86b0-cc3258bea5de tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:04.617824 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:04.623427 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a157e85e-50d5-41d8-86b0-cc3258bea5de tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:04.623926 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a157e85e-50d5-41d8-86b0-cc3258bea5de tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:04.624712 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a157e85e-50d5-41d8-86b0-cc3258bea5de tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:04.625142 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a157e85e-50d5-41d8-86b0-cc3258bea5de tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:04.772271 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a157e85e-50d5-41d8-86b0-cc3258bea5de tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:04.785224 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a157e85e-50d5-41d8-86b0-cc3258bea5de tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:04.787533 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a157e85e-50d5-41d8-86b0-cc3258bea5de tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:04.789312 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a157e85e-50d5-41d8-86b0-cc3258bea5de tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1719 microversion: 2.20 time: 0.181539 May 24 15:44:04.789870 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 329/702] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:04 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:05.809601 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6167c5a8-15e2-4a45-b8eb-422486d3abe9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:05.810396 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6167c5a8-15e2-4a45-b8eb-422486d3abe9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:05.819716 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6167c5a8-15e2-4a45-b8eb-422486d3abe9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.820415 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6167c5a8-15e2-4a45-b8eb-422486d3abe9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:05.821481 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6167c5a8-15e2-4a45-b8eb-422486d3abe9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.821920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6167c5a8-15e2-4a45-b8eb-422486d3abe9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:05.956544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6167c5a8-15e2-4a45-b8eb-422486d3abe9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:05.967018 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6167c5a8-15e2-4a45-b8eb-422486d3abe9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:05.968608 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6167c5a8-15e2-4a45-b8eb-422486d3abe9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:05.969763 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6167c5a8-15e2-4a45-b8eb-422486d3abe9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1722 microversion: 2.20 time: 0.165648 May 24 15:44:05.970351 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 374/703] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:05 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:05.987668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-55e1135e-2734-498a-bdb6-7bfcbcba9497 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c1eca90-cfd4-452a-9de9-37503e86d0a1"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:05.988822 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-55e1135e-2734-498a-bdb6-7bfcbcba9497 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:05.995480 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-55e1135e-2734-498a-bdb6-7bfcbcba9497 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.995917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-55e1135e-2734-498a-bdb6-7bfcbcba9497 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:05.996701 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-55e1135e-2734-498a-bdb6-7bfcbcba9497 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:05.997122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-55e1135e-2734-498a-bdb6-7bfcbcba9497 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:06.308669 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-55e1135e-2734-498a-bdb6-7bfcbcba9497 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "POST /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324877 May 24 15:44:06.309280 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 330/704] 10.222.0.55 () {62 vars in 1363 bytes} [Tue May 24 15:44:05 2022] POST /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 15:44:06.441349 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d426e4c2-3088-433c-99ce-bfbb363490c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:06.441845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d426e4c2-3088-433c-99ce-bfbb363490c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:06.443854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=60 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:06.449896 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d426e4c2-3088-433c-99ce-bfbb363490c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:06.450375 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d426e4c2-3088-433c-99ce-bfbb363490c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:06.451147 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d426e4c2-3088-433c-99ce-bfbb363490c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:06.451574 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d426e4c2-3088-433c-99ce-bfbb363490c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:06.718843 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d426e4c2-3088-433c-99ce-bfbb363490c1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "DELETE /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/os-volume_attachments/2c1eca90-cfd4-452a-9de9-37503e86d0a1" status: 202 len: 0 microversion: 2.20 time: 0.281621 May 24 15:44:06.719684 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 375/705] 10.222.0.55 () {60 vars in 1456 bytes} [Tue May 24 15:44:06 2022] DELETE /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/os-volume_attachments/2c1eca90-cfd4-452a-9de9-37503e86d0a1 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 15:44:06.793428 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ed2d01c3-2f3a-4650-ac8e-364023948826 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:06.794004 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ed2d01c3-2f3a-4650-ac8e-364023948826 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:06.801255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ed2d01c3-2f3a-4650-ac8e-364023948826 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:06.801699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ed2d01c3-2f3a-4650-ac8e-364023948826 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:06.802449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ed2d01c3-2f3a-4650-ac8e-364023948826 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:06.802872 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ed2d01c3-2f3a-4650-ac8e-364023948826 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:06.905687 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ed2d01c3-2f3a-4650-ac8e-364023948826 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "POST /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/action" status: 202 len: 0 microversion: 2.20 time: 0.116503 May 24 15:44:06.906297 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 331/706] 10.222.0.55 () {62 vars in 1318 bytes} [Tue May 24 15:44:06 2022] POST /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 15:44:06.914635 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-01fc8e2b-3215-4d3d-bc17-efa0c7da570c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:06.915255 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-01fc8e2b-3215-4d3d-bc17-efa0c7da570c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:06.922300 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01fc8e2b-3215-4d3d-bc17-efa0c7da570c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:06.922749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01fc8e2b-3215-4d3d-bc17-efa0c7da570c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:06.923571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01fc8e2b-3215-4d3d-bc17-efa0c7da570c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:06.924002 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-01fc8e2b-3215-4d3d-bc17-efa0c7da570c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:07.070612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-01fc8e2b-3215-4d3d-bc17-efa0c7da570c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:07.078830 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-01fc8e2b-3215-4d3d-bc17-efa0c7da570c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:07.080650 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-01fc8e2b-3215-4d3d-bc17-efa0c7da570c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:07.081805 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-01fc8e2b-3215-4d3d-bc17-efa0c7da570c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1670 microversion: 2.20 time: 0.171323 May 24 15:44:07.082379 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 376/707] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:06 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:44:08.100404 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-73008a3d-0bc4-4f30-8fbe-87119dbba544 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:08.101034 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-73008a3d-0bc4-4f30-8fbe-87119dbba544 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:08.107051 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-73008a3d-0bc4-4f30-8fbe-87119dbba544 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.107503 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-73008a3d-0bc4-4f30-8fbe-87119dbba544 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:08.108303 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-73008a3d-0bc4-4f30-8fbe-87119dbba544 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.108934 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-73008a3d-0bc4-4f30-8fbe-87119dbba544 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:08.151776 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-9a374890-c65c-4a74-848e-c8b374f1827d req-28931481-e814-4982-8266-d9cea57a01bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a52505-bbe8-48c0-ba6f-ec99a6980285", "name": "network-vif-unplugged", "status": "completed", "tag": "f0b68296-7928-4ede-98e0-8adf6abeff09"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:08.162435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-9a374890-c65c-4a74-848e-c8b374f1827d req-28931481-e814-4982-8266-d9cea57a01bd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.162882 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-9a374890-c65c-4a74-848e-c8b374f1827d req-28931481-e814-4982-8266-d9cea57a01bd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:08.175371 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-9a374890-c65c-4a74-848e-c8b374f1827d req-28931481-e814-4982-8266-d9cea57a01bd service nova] Creating event network-vif-unplugged:f0b68296-7928-4ede-98e0-8adf6abeff09 for instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 on hv-cinder-84315 May 24 15:44:08.181035 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-9a374890-c65c-4a74-848e-c8b374f1827d req-28931481-e814-4982-8266-d9cea57a01bd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033772 May 24 15:44:08.181933 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 377/708] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:08.241045 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-73008a3d-0bc4-4f30-8fbe-87119dbba544 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:08.249134 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-73008a3d-0bc4-4f30-8fbe-87119dbba544 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:08.250661 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-73008a3d-0bc4-4f30-8fbe-87119dbba544 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:08.252344 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-73008a3d-0bc4-4f30-8fbe-87119dbba544 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.156028 May 24 15:44:08.252344 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 332/709] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:08 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:08.842989 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-12960b06-3f05-411b-804f-760311027fb8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:08.843570 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-12960b06-3f05-411b-804f-760311027fb8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:08.849991 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12960b06-3f05-411b-804f-760311027fb8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.850426 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12960b06-3f05-411b-804f-760311027fb8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:08.851167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12960b06-3f05-411b-804f-760311027fb8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.851655 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-12960b06-3f05-411b-804f-760311027fb8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:08.877239 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-12960b06-3f05-411b-804f-760311027fb8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Going to try to terminate instance {{(pid=129340) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:44:08.961298 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-12960b06-3f05-411b-804f-760311027fb8 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 204 len: 0 microversion: 2.1 time: 0.122425 May 24 15:44:08.962522 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 378/710] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:44:08 2022] DELETE /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:44:08.970688 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f98e3d7a-7316-4685-bc55-4dea312b6863 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:08.971596 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f98e3d7a-7316-4685-bc55-4dea312b6863 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:08.978028 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f98e3d7a-7316-4685-bc55-4dea312b6863 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.978509 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f98e3d7a-7316-4685-bc55-4dea312b6863 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:08.979293 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f98e3d7a-7316-4685-bc55-4dea312b6863 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:08.979929 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f98e3d7a-7316-4685-bc55-4dea312b6863 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:09.111093 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f98e3d7a-7316-4685-bc55-4dea312b6863 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:09.118941 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f98e3d7a-7316-4685-bc55-4dea312b6863 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1575 microversion: 2.1 time: 0.152192 May 24 15:44:09.119739 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 333/711] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:08 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:09.276535 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c662a6eb-e44b-4ddd-a706-df6d1decc2ae tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:09.277672 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c662a6eb-e44b-4ddd-a706-df6d1decc2ae tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:09.288635 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c662a6eb-e44b-4ddd-a706-df6d1decc2ae tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:09.289376 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c662a6eb-e44b-4ddd-a706-df6d1decc2ae tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:09.290796 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c662a6eb-e44b-4ddd-a706-df6d1decc2ae tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:09.291007 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c662a6eb-e44b-4ddd-a706-df6d1decc2ae tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:09.437086 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c662a6eb-e44b-4ddd-a706-df6d1decc2ae tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:09.445366 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c662a6eb-e44b-4ddd-a706-df6d1decc2ae tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:09.447010 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c662a6eb-e44b-4ddd-a706-df6d1decc2ae tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:09.448184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c662a6eb-e44b-4ddd-a706-df6d1decc2ae tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.179160 May 24 15:44:09.448745 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 379/712] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:09 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:10.140897 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a1bcfd1b-4642-41b8-9e93-8606f65a4cb7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:10.142291 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a1bcfd1b-4642-41b8-9e93-8606f65a4cb7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:10.153358 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a1bcfd1b-4642-41b8-9e93-8606f65a4cb7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:10.154111 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a1bcfd1b-4642-41b8-9e93-8606f65a4cb7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:10.155336 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a1bcfd1b-4642-41b8-9e93-8606f65a4cb7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:10.156088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a1bcfd1b-4642-41b8-9e93-8606f65a4cb7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:10.347182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a1bcfd1b-4642-41b8-9e93-8606f65a4cb7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:10.359053 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a1bcfd1b-4642-41b8-9e93-8606f65a4cb7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1575 microversion: 2.1 time: 0.224413 May 24 15:44:10.359875 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 334/713] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:10 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:10.474086 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-5d20c9d5-1ddc-4919-bc72-07669ed833e7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:10.474929 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-5d20c9d5-1ddc-4919-bc72-07669ed833e7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:10.482714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5d20c9d5-1ddc-4919-bc72-07669ed833e7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:10.483162 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5d20c9d5-1ddc-4919-bc72-07669ed833e7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:10.483969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5d20c9d5-1ddc-4919-bc72-07669ed833e7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:10.484430 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5d20c9d5-1ddc-4919-bc72-07669ed833e7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:10.622111 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-5d20c9d5-1ddc-4919-bc72-07669ed833e7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:10.624530 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:10.631936 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-5d20c9d5-1ddc-4919-bc72-07669ed833e7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:10.633510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-5d20c9d5-1ddc-4919-bc72-07669ed833e7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:10.634758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-5d20c9d5-1ddc-4919-bc72-07669ed833e7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.165864 May 24 15:44:10.635921 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 380/714] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:10 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:11.377951 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-dd1b279f-593c-4b66-b790-f002929d8be9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:11.379260 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-dd1b279f-593c-4b66-b790-f002929d8be9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:11.389889 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd1b279f-593c-4b66-b790-f002929d8be9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:11.391242 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd1b279f-593c-4b66-b790-f002929d8be9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:11.392899 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd1b279f-593c-4b66-b790-f002929d8be9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:11.396440 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd1b279f-593c-4b66-b790-f002929d8be9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:11.655607 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-31819803-f336-4ea7-a41c-a599d1ccf4b7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:11.656873 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-31819803-f336-4ea7-a41c-a599d1ccf4b7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:11.665368 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-31819803-f336-4ea7-a41c-a599d1ccf4b7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:11.666175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-31819803-f336-4ea7-a41c-a599d1ccf4b7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:11.667428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-31819803-f336-4ea7-a41c-a599d1ccf4b7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:11.668022 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-31819803-f336-4ea7-a41c-a599d1ccf4b7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:11.674672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-dd1b279f-593c-4b66-b790-f002929d8be9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:11.686647 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-dd1b279f-593c-4b66-b790-f002929d8be9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1575 microversion: 2.1 time: 0.312001 May 24 15:44:11.687963 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 335/715] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:11 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1575 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:11.844818 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-31819803-f336-4ea7-a41c-a599d1ccf4b7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:11.855367 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-31819803-f336-4ea7-a41c-a599d1ccf4b7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:11.857424 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-31819803-f336-4ea7-a41c-a599d1ccf4b7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:11.859234 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-31819803-f336-4ea7-a41c-a599d1ccf4b7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.208936 May 24 15:44:11.860070 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 381/716] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:11 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:44:12.286442 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-1e1cafd8-b06c-4614-a6c9-c5bbeb0bef74 req-b9b97544-5a4a-439c-9d83-586218cf5832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac339a5-757e-4d9d-9216-7a2a399b8fef", "name": "network-vif-deleted", "tag": "e0ffdaca-f0bd-4260-8199-fa981543ea63"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:12.295107 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-1e1cafd8-b06c-4614-a6c9-c5bbeb0bef74 req-b9b97544-5a4a-439c-9d83-586218cf5832 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:12.295823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-1e1cafd8-b06c-4614-a6c9-c5bbeb0bef74 req-b9b97544-5a4a-439c-9d83-586218cf5832 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:12.318406 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-1e1cafd8-b06c-4614-a6c9-c5bbeb0bef74 req-b9b97544-5a4a-439c-9d83-586218cf5832 service nova] Creating event network-vif-deleted:e0ffdaca-f0bd-4260-8199-fa981543ea63 for instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef on hv-cinder-84315 May 24 15:44:12.333948 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-1e1cafd8-b06c-4614-a6c9-c5bbeb0bef74 req-b9b97544-5a4a-439c-9d83-586218cf5832 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051106 May 24 15:44:12.334865 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 336/717] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:12.704392 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-196d036b-1a7e-45f1-b3ef-1ed0a3882b72 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:12.705700 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-196d036b-1a7e-45f1-b3ef-1ed0a3882b72 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:12.712781 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-196d036b-1a7e-45f1-b3ef-1ed0a3882b72 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:12.713294 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-196d036b-1a7e-45f1-b3ef-1ed0a3882b72 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:12.714332 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-196d036b-1a7e-45f1-b3ef-1ed0a3882b72 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:12.714859 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-196d036b-1a7e-45f1-b3ef-1ed0a3882b72 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:12.780189 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-196d036b-1a7e-45f1-b3ef-1ed0a3882b72 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:12.791227 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-196d036b-1a7e-45f1-b3ef-1ed0a3882b72 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1507 microversion: 2.1 time: 0.090805 May 24 15:44:12.792224 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 382/718] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:12 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1507 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:12.879686 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-53119e72-49e3-4175-9ce2-5e2a51dbebce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:12.881074 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-53119e72-49e3-4175-9ce2-5e2a51dbebce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:12.887814 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-53119e72-49e3-4175-9ce2-5e2a51dbebce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:12.888670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-53119e72-49e3-4175-9ce2-5e2a51dbebce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:12.889718 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-53119e72-49e3-4175-9ce2-5e2a51dbebce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:12.890372 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-53119e72-49e3-4175-9ce2-5e2a51dbebce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:13.048447 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-53119e72-49e3-4175-9ce2-5e2a51dbebce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:13.057999 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-53119e72-49e3-4175-9ce2-5e2a51dbebce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:13.059862 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-53119e72-49e3-4175-9ce2-5e2a51dbebce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:13.061074 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-53119e72-49e3-4175-9ce2-5e2a51dbebce tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.186253 May 24 15:44:13.061647 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 337/719] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:12 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:13.810506 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7b9d705e-2e7f-4b3e-ab89-cb057732d1a7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:13.811360 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7b9d705e-2e7f-4b3e-ab89-cb057732d1a7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:13.818904 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7b9d705e-2e7f-4b3e-ab89-cb057732d1a7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:13.819578 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7b9d705e-2e7f-4b3e-ab89-cb057732d1a7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:13.820696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7b9d705e-2e7f-4b3e-ab89-cb057732d1a7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:13.821183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7b9d705e-2e7f-4b3e-ab89-cb057732d1a7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:13.897550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7b9d705e-2e7f-4b3e-ab89-cb057732d1a7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:13.906679 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7b9d705e-2e7f-4b3e-ab89-cb057732d1a7 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1507 microversion: 2.1 time: 0.101159 May 24 15:44:13.907266 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 383/720] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:13 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1507 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:14.079613 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0edc474a-ec52-4430-ba49-b7a207541013 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:14.080299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0edc474a-ec52-4430-ba49-b7a207541013 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:14.088418 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0edc474a-ec52-4430-ba49-b7a207541013 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:14.088934 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0edc474a-ec52-4430-ba49-b7a207541013 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:14.089715 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0edc474a-ec52-4430-ba49-b7a207541013 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:14.090145 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0edc474a-ec52-4430-ba49-b7a207541013 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:14.225249 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0edc474a-ec52-4430-ba49-b7a207541013 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:14.233852 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0edc474a-ec52-4430-ba49-b7a207541013 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:14.235344 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0edc474a-ec52-4430-ba49-b7a207541013 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:14.236563 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0edc474a-ec52-4430-ba49-b7a207541013 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.161059 May 24 15:44:14.237132 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 338/721] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:14 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:14.924839 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7e32c177-e69e-4e2c-9212-d1fe40b94391 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:14.925685 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7e32c177-e69e-4e2c-9212-d1fe40b94391 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:14.932624 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e32c177-e69e-4e2c-9212-d1fe40b94391 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:14.933087 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e32c177-e69e-4e2c-9212-d1fe40b94391 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:14.933849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e32c177-e69e-4e2c-9212-d1fe40b94391 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:14.934315 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7e32c177-e69e-4e2c-9212-d1fe40b94391 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:14.999931 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7e32c177-e69e-4e2c-9212-d1fe40b94391 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:15.007907 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7e32c177-e69e-4e2c-9212-d1fe40b94391 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1507 microversion: 2.1 time: 0.087229 May 24 15:44:15.008512 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 384/722] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:14 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1507 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:15.255394 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a043a6ab-b866-4a4c-87e5-383f4755f90e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:15.256003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a043a6ab-b866-4a4c-87e5-383f4755f90e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:15.263312 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a043a6ab-b866-4a4c-87e5-383f4755f90e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:15.263755 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a043a6ab-b866-4a4c-87e5-383f4755f90e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:15.264543 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a043a6ab-b866-4a4c-87e5-383f4755f90e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:15.265230 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a043a6ab-b866-4a4c-87e5-383f4755f90e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:15.409299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a043a6ab-b866-4a4c-87e5-383f4755f90e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:15.418367 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a043a6ab-b866-4a4c-87e5-383f4755f90e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:15.420961 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a043a6ab-b866-4a4c-87e5-383f4755f90e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:15.421152 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a043a6ab-b866-4a4c-87e5-383f4755f90e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.170019 May 24 15:44:15.421886 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 339/723] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:15 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:16.026173 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3adcaa98-b816-4e92-9ad7-dd8fbbd7d976 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:16.026841 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3adcaa98-b816-4e92-9ad7-dd8fbbd7d976 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:16.033953 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3adcaa98-b816-4e92-9ad7-dd8fbbd7d976 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:16.034401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3adcaa98-b816-4e92-9ad7-dd8fbbd7d976 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:16.035185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3adcaa98-b816-4e92-9ad7-dd8fbbd7d976 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:16.035614 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3adcaa98-b816-4e92-9ad7-dd8fbbd7d976 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:16.099674 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3adcaa98-b816-4e92-9ad7-dd8fbbd7d976 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:16.107671 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3adcaa98-b816-4e92-9ad7-dd8fbbd7d976 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1507 microversion: 2.1 time: 0.085660 May 24 15:44:16.108480 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 385/724] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:16 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1507 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:16.440022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e0ce666c-99bb-45fd-b59a-b915b8bd43dc tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:16.440668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e0ce666c-99bb-45fd-b59a-b915b8bd43dc tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:16.447363 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0ce666c-99bb-45fd-b59a-b915b8bd43dc tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:16.447810 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0ce666c-99bb-45fd-b59a-b915b8bd43dc tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:16.448602 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0ce666c-99bb-45fd-b59a-b915b8bd43dc tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:16.449033 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e0ce666c-99bb-45fd-b59a-b915b8bd43dc tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:16.589253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e0ce666c-99bb-45fd-b59a-b915b8bd43dc tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:16.598468 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e0ce666c-99bb-45fd-b59a-b915b8bd43dc tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:16.599949 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e0ce666c-99bb-45fd-b59a-b915b8bd43dc tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:16.601145 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e0ce666c-99bb-45fd-b59a-b915b8bd43dc tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.165255 May 24 15:44:16.601719 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 340/725] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:16 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:44:17.124896 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-77eaf31c-83b1-4fff-b5b3-1659afc2f957 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:17.125537 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-77eaf31c-83b1-4fff-b5b3-1659afc2f957 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:17.133645 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-77eaf31c-83b1-4fff-b5b3-1659afc2f957 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:17.134078 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-77eaf31c-83b1-4fff-b5b3-1659afc2f957 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:17.134863 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-77eaf31c-83b1-4fff-b5b3-1659afc2f957 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:17.135300 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-77eaf31c-83b1-4fff-b5b3-1659afc2f957 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:17.203340 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-77eaf31c-83b1-4fff-b5b3-1659afc2f957 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:17.217004 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-77eaf31c-83b1-4fff-b5b3-1659afc2f957 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1507 microversion: 2.1 time: 0.095026 May 24 15:44:17.218925 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 386/726] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:17 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1507 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:17.619896 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bf38d577-290b-4ca6-a72c-cb0965d252f4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:17.621321 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bf38d577-290b-4ca6-a72c-cb0965d252f4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:17.629393 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf38d577-290b-4ca6-a72c-cb0965d252f4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:17.630256 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf38d577-290b-4ca6-a72c-cb0965d252f4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:17.631101 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf38d577-290b-4ca6-a72c-cb0965d252f4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:17.631751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bf38d577-290b-4ca6-a72c-cb0965d252f4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:17.776797 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bf38d577-290b-4ca6-a72c-cb0965d252f4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:17.785510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bf38d577-290b-4ca6-a72c-cb0965d252f4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:17.787140 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bf38d577-290b-4ca6-a72c-cb0965d252f4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:17.788806 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bf38d577-290b-4ca6-a72c-cb0965d252f4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.172990 May 24 15:44:17.789975 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 341/727] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:17 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:18.237607 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d0724cdf-ee98-47af-9121-fe0ab368bc62 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:18.238374 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d0724cdf-ee98-47af-9121-fe0ab368bc62 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:18.245975 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0724cdf-ee98-47af-9121-fe0ab368bc62 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:18.246418 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0724cdf-ee98-47af-9121-fe0ab368bc62 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:18.247185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0724cdf-ee98-47af-9121-fe0ab368bc62 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:18.247639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0724cdf-ee98-47af-9121-fe0ab368bc62 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:18.312735 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d0724cdf-ee98-47af-9121-fe0ab368bc62 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:18.320544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d0724cdf-ee98-47af-9121-fe0ab368bc62 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1507 microversion: 2.1 time: 0.089154 May 24 15:44:18.321120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 387/728] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:18 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1507 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:18.807288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6e19726b-eef3-4aae-a2b6-1ca2ef78ab93 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:18.808730 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6e19726b-eef3-4aae-a2b6-1ca2ef78ab93 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:18.815642 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6e19726b-eef3-4aae-a2b6-1ca2ef78ab93 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:18.816111 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6e19726b-eef3-4aae-a2b6-1ca2ef78ab93 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:18.817127 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6e19726b-eef3-4aae-a2b6-1ca2ef78ab93 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:18.817705 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6e19726b-eef3-4aae-a2b6-1ca2ef78ab93 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:18.822122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:18.971057 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6e19726b-eef3-4aae-a2b6-1ca2ef78ab93 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:18.979762 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6e19726b-eef3-4aae-a2b6-1ca2ef78ab93 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:18.981289 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6e19726b-eef3-4aae-a2b6-1ca2ef78ab93 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:18.982616 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6e19726b-eef3-4aae-a2b6-1ca2ef78ab93 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.179528 May 24 15:44:18.983190 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 342/729] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:18 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 15:44:19.338371 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ecaf5c9c-c06f-44b0-aae9-feea975a529f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:19.339115 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ecaf5c9c-c06f-44b0-aae9-feea975a529f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:19.345794 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ecaf5c9c-c06f-44b0-aae9-feea975a529f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:19.346229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ecaf5c9c-c06f-44b0-aae9-feea975a529f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:19.347000 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ecaf5c9c-c06f-44b0-aae9-feea975a529f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:19.347430 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ecaf5c9c-c06f-44b0-aae9-feea975a529f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:19.411698 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ecaf5c9c-c06f-44b0-aae9-feea975a529f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:19.419565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ecaf5c9c-c06f-44b0-aae9-feea975a529f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1507 microversion: 2.1 time: 0.085181 May 24 15:44:19.420153 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 388/730] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:19 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1507 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:20.001695 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0bf9130f-3577-413b-ba1f-f4a242b126e1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:20.002333 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0bf9130f-3577-413b-ba1f-f4a242b126e1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:20.009122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0bf9130f-3577-413b-ba1f-f4a242b126e1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:20.009561 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0bf9130f-3577-413b-ba1f-f4a242b126e1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:20.010312 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0bf9130f-3577-413b-ba1f-f4a242b126e1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:20.010739 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0bf9130f-3577-413b-ba1f-f4a242b126e1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:20.147054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0bf9130f-3577-413b-ba1f-f4a242b126e1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:20.155084 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0bf9130f-3577-413b-ba1f-f4a242b126e1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:20.156682 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0bf9130f-3577-413b-ba1f-f4a242b126e1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:20.157835 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0bf9130f-3577-413b-ba1f-f4a242b126e1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.160274 May 24 15:44:20.158389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 343/731] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:19 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:20.438117 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c37b3228-3ec7-49a5-a5e7-b55658e61076 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:20.438940 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c37b3228-3ec7-49a5-a5e7-b55658e61076 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:20.447025 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c37b3228-3ec7-49a5-a5e7-b55658e61076 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:20.447587 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c37b3228-3ec7-49a5-a5e7-b55658e61076 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:20.448550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c37b3228-3ec7-49a5-a5e7-b55658e61076 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:20.449050 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c37b3228-3ec7-49a5-a5e7-b55658e61076 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:20.766353 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c37b3228-3ec7-49a5-a5e7-b55658e61076 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:20.779625 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c37b3228-3ec7-49a5-a5e7-b55658e61076 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1507 microversion: 2.1 time: 0.345897 May 24 15:44:20.780591 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 389/732] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:20 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:21.176738 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-36413fd4-5704-4e64-a9e7-db3bdbe3551c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:21.177321 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-36413fd4-5704-4e64-a9e7-db3bdbe3551c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:21.184185 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-36413fd4-5704-4e64-a9e7-db3bdbe3551c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:21.184632 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-36413fd4-5704-4e64-a9e7-db3bdbe3551c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:21.185399 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-36413fd4-5704-4e64-a9e7-db3bdbe3551c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:21.185832 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-36413fd4-5704-4e64-a9e7-db3bdbe3551c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:21.319704 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-36413fd4-5704-4e64-a9e7-db3bdbe3551c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:21.327727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-36413fd4-5704-4e64-a9e7-db3bdbe3551c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:21.329331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-36413fd4-5704-4e64-a9e7-db3bdbe3551c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:21.330494 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-36413fd4-5704-4e64-a9e7-db3bdbe3551c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.157935 May 24 15:44:21.331065 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 344/733] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:21 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:21.799935 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a0dfe8d4-4049-41ce-874c-0fda3aada809 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:21.800565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a0dfe8d4-4049-41ce-874c-0fda3aada809 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:21.807851 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0dfe8d4-4049-41ce-874c-0fda3aada809 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:21.808357 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0dfe8d4-4049-41ce-874c-0fda3aada809 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:21.809157 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0dfe8d4-4049-41ce-874c-0fda3aada809 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:21.809637 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0dfe8d4-4049-41ce-874c-0fda3aada809 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:21.872823 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a0dfe8d4-4049-41ce-874c-0fda3aada809 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:21.885396 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a0dfe8d4-4049-41ce-874c-0fda3aada809 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 200 len: 1224 microversion: 2.1 time: 0.090516 May 24 15:44:21.886237 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 390/734] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:21 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:22.277119 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-553fb8e9-4e54-48c9-b1ee-bf2149e061dc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:22.278068 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-553fb8e9-4e54-48c9-b1ee-bf2149e061dc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:22.285034 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-553fb8e9-4e54-48c9-b1ee-bf2149e061dc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:22.285474 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-553fb8e9-4e54-48c9-b1ee-bf2149e061dc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:22.286226 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-553fb8e9-4e54-48c9-b1ee-bf2149e061dc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:22.286653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-553fb8e9-4e54-48c9-b1ee-bf2149e061dc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:22.348537 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2a12f6de-6966-4c2c-9f0f-d27aeec55e6f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:22.349201 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2a12f6de-6966-4c2c-9f0f-d27aeec55e6f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:22.355398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2a12f6de-6966-4c2c-9f0f-d27aeec55e6f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:22.355845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2a12f6de-6966-4c2c-9f0f-d27aeec55e6f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:22.356643 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2a12f6de-6966-4c2c-9f0f-d27aeec55e6f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:22.357072 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2a12f6de-6966-4c2c-9f0f-d27aeec55e6f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:22.366033 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-553fb8e9-4e54-48c9-b1ee-bf2149e061dc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "POST /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/action" status: 202 len: 0 microversion: 2.1 time: 0.092836 May 24 15:44:22.366669 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 345/735] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:44:22 2022] POST /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:44:22.376960 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-04c3e9cf-5fdc-4037-8270-87f83650e69b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:22.378313 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-04c3e9cf-5fdc-4037-8270-87f83650e69b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:22.386572 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-04c3e9cf-5fdc-4037-8270-87f83650e69b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:22.387105 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-04c3e9cf-5fdc-4037-8270-87f83650e69b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:22.387968 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-04c3e9cf-5fdc-4037-8270-87f83650e69b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:22.388403 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-04c3e9cf-5fdc-4037-8270-87f83650e69b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:22.570143 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2a12f6de-6966-4c2c-9f0f-d27aeec55e6f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:22.580103 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2a12f6de-6966-4c2c-9f0f-d27aeec55e6f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:22.581696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2a12f6de-6966-4c2c-9f0f-d27aeec55e6f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:22.583006 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2a12f6de-6966-4c2c-9f0f-d27aeec55e6f tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.238499 May 24 15:44:22.583915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 391/736] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:22 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:22.586372 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-04c3e9cf-5fdc-4037-8270-87f83650e69b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:22.595157 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-04c3e9cf-5fdc-4037-8270-87f83650e69b tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1752 microversion: 2.1 time: 0.223914 May 24 15:44:22.595885 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 346/737] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:22 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1752 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:22.905614 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f89b2af9-8f29-427f-b4eb-385bdce478b1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:22.906432 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f89b2af9-8f29-427f-b4eb-385bdce478b1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:22.913494 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f89b2af9-8f29-427f-b4eb-385bdce478b1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:22.913911 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f89b2af9-8f29-427f-b4eb-385bdce478b1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:22.914717 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f89b2af9-8f29-427f-b4eb-385bdce478b1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:22.915148 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f89b2af9-8f29-427f-b4eb-385bdce478b1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:22.931276 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-f89b2af9-8f29-427f-b4eb-385bdce478b1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] HTTP exception thrown: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f89b2af9-8f29-427f-b4eb-385bdce478b1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Request method failure captured: May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef HTTP/1.1 May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPyIQ-g2G4_6sjY84YEOfAHfxpPhW0DIprj7s7Q462wvMHAGyimX5GHKRinQJh8hoUC6_pJLByJeKuLDuEtWQ1sZyAE_qvOMtZJ0PfKu9xuP5PPUS_mtI9HVdkH4SL9U0SrJtppVhlEM6QHjUM4iHoJ_2VPxrLk0JEnhPPtW5d7C3UY May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: dc2810000275432fb1337151b6883e90 May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-TestVolumeBootPattern-1830429659 May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:44:22.932969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dc2810000275432fb1337151b6883e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dc2810000275432fb1337151b6883e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dc2810000275432fb1337151b6883e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dc2810000275432fb1337151b6883e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-TestVolumeBootPattern-1830429659 May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: dc2810000275432fb1337151b6883e90 May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830429659 May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-TestVolumeBootPattern-1830429659-project May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 0a3a64d88e89402b907789c7f030e080 May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-TestVolumeBootPattern-1830429659-project May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:44:22.934387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '6ac339a5-757e-4d9d-9216-7a2a399b8fef'} May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:44:22.935228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:44:22.936550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:44:22.937976 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f89b2af9-8f29-427f-b4eb-385bdce478b1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Returning 404 to user: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:44:22.937976 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f89b2af9-8f29-427f-b4eb-385bdce478b1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 404 len: 111 microversion: 2.1 time: 0.032879 May 24 15:44:22.937976 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 392/738] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:22 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:44:23.035961 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1350794526", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-466910550", "security_groups": [{"name": "tempest-secgroup-smoke-1280392271"}], "block_device_mapping_v2": [{"uuid": "7772a0f8-e069-4de1-837a-c0b6269b0c6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba8b5a97-3a6a-415b-bd0c-40ca3fe3e6b1"}]}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:23.150360 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] validate_networks() for [('ba8b5a97-3a6a-415b-bd0c-40ca3fe3e6b1', None, None, None, None, None)] {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:44:23.524827 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:44:23.525468 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:44:23.525841 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:44:23.526331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:44:23.526887 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:44:23.540565 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:23.541189 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:23.542409 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:23.543055 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:23.562219 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Getting quotas for project dc2810000275432fb1337151b6883e90. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:44:23.566664 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Getting quotas for user 0a3a64d88e89402b907789c7f030e080 and project dc2810000275432fb1337151b6883e90. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:44:23.602632 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-bba03b45-d412-4058-bdf9-6646ebcc9dc4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:23.603256 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-bba03b45-d412-4058-bdf9-6646ebcc9dc4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:23.610401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bba03b45-d412-4058-bdf9-6646ebcc9dc4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:23.610844 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bba03b45-d412-4058-bdf9-6646ebcc9dc4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:23.611617 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bba03b45-d412-4058-bdf9-6646ebcc9dc4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:23.612087 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bba03b45-d412-4058-bdf9-6646ebcc9dc4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:23.630335 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:44:23.632503 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7772a0f8-e069-4de1-837a-c0b6269b0c6d',volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:44:23.756332 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-bba03b45-d412-4058-bdf9-6646ebcc9dc4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:23.764642 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-bba03b45-d412-4058-bdf9-6646ebcc9dc4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:23.766546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-bba03b45-d412-4058-bdf9-6646ebcc9dc4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:23.767699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-bba03b45-d412-4058-bdf9-6646ebcc9dc4 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.169039 May 24 15:44:23.768289 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 393/739] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:23 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:23.772826 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f77769a1-2a89-4147-8e37-cf73d83eaf29 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:23.775866 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-73de21eb-89a7-42f3-994c-b154c4124bff tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.743807 May 24 15:44:23.776788 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 347/740] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:44:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:44:23.784466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f77769a1-2a89-4147-8e37-cf73d83eaf29 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:23.786517 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-924e5fa2-7e75-4b68-b34a-40425b1f6301 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:23.787336 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-924e5fa2-7e75-4b68-b34a-40425b1f6301 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:23.791629 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f77769a1-2a89-4147-8e37-cf73d83eaf29 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:23.792332 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f77769a1-2a89-4147-8e37-cf73d83eaf29 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:23.793195 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f77769a1-2a89-4147-8e37-cf73d83eaf29 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:23.793693 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f77769a1-2a89-4147-8e37-cf73d83eaf29 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:23.845849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-924e5fa2-7e75-4b68-b34a-40425b1f6301 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:23.854121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-924e5fa2-7e75-4b68-b34a-40425b1f6301 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1094 microversion: 2.1 time: 0.071483 May 24 15:44:23.854817 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 348/741] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:23 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:44:23.961252 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f77769a1-2a89-4147-8e37-cf73d83eaf29 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:23.971315 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f77769a1-2a89-4147-8e37-cf73d83eaf29 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1757 microversion: 2.1 time: 0.201996 May 24 15:44:23.972003 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 394/742] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:23 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:24.787680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ba18f6b0-481c-4698-9d39-558db88ed8b0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:24.788342 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ba18f6b0-481c-4698-9d39-558db88ed8b0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:24.795492 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ba18f6b0-481c-4698-9d39-558db88ed8b0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:24.796344 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ba18f6b0-481c-4698-9d39-558db88ed8b0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:24.797344 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ba18f6b0-481c-4698-9d39-558db88ed8b0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:24.798213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ba18f6b0-481c-4698-9d39-558db88ed8b0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:24.871209 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-62f5570c-3885-488c-bb36-488e086b54a5 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:24.871735 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-62f5570c-3885-488c-bb36-488e086b54a5 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:24.878225 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-62f5570c-3885-488c-bb36-488e086b54a5 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:24.878895 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-62f5570c-3885-488c-bb36-488e086b54a5 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:24.879884 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-62f5570c-3885-488c-bb36-488e086b54a5 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:24.880494 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-62f5570c-3885-488c-bb36-488e086b54a5 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:24.958534 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-62f5570c-3885-488c-bb36-488e086b54a5 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:24.967079 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-62f5570c-3885-488c-bb36-488e086b54a5 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1210 microversion: 2.1 time: 0.099988 May 24 15:44:24.970333 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 395/743] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:24 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:44:24.971756 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ba18f6b0-481c-4698-9d39-558db88ed8b0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:24.980177 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ba18f6b0-481c-4698-9d39-558db88ed8b0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:24.981792 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ba18f6b0-481c-4698-9d39-558db88ed8b0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:24.983030 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ba18f6b0-481c-4698-9d39-558db88ed8b0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.200947 May 24 15:44:24.983653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 349/744] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:24 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:24.989429 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6e030274-eaa6-4968-9f0c-413a99981195 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:24.990041 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6e030274-eaa6-4968-9f0c-413a99981195 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:24.996385 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6e030274-eaa6-4968-9f0c-413a99981195 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:24.996827 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6e030274-eaa6-4968-9f0c-413a99981195 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:24.997586 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6e030274-eaa6-4968-9f0c-413a99981195 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:24.998012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6e030274-eaa6-4968-9f0c-413a99981195 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:25.154750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6e030274-eaa6-4968-9f0c-413a99981195 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:25.164530 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6e030274-eaa6-4968-9f0c-413a99981195 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1757 microversion: 2.1 time: 0.179102 May 24 15:44:25.165109 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 396/745] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:24 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:25.985302 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9b148c43-4c51-4343-9f0f-e927c45c6851 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:25.986457 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9b148c43-4c51-4343-9f0f-e927c45c6851 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:25.993196 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9b148c43-4c51-4343-9f0f-e927c45c6851 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:25.993649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9b148c43-4c51-4343-9f0f-e927c45c6851 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:25.994649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9b148c43-4c51-4343-9f0f-e927c45c6851 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:25.994820 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9b148c43-4c51-4343-9f0f-e927c45c6851 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:26.002684 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a42afa52-8d90-4cfa-8175-9a2c0037229c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:26.003479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a42afa52-8d90-4cfa-8175-9a2c0037229c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:26.010729 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a42afa52-8d90-4cfa-8175-9a2c0037229c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:26.011528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a42afa52-8d90-4cfa-8175-9a2c0037229c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:26.012477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a42afa52-8d90-4cfa-8175-9a2c0037229c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:26.012985 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a42afa52-8d90-4cfa-8175-9a2c0037229c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:26.255471 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9b148c43-4c51-4343-9f0f-e927c45c6851 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:26.267963 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9b148c43-4c51-4343-9f0f-e927c45c6851 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.286268 May 24 15:44:26.268778 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 350/746] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:25 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:26.277162 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a9fc02ef-7d6f-41d3-b167-16428bc4b1cc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:26.277966 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a9fc02ef-7d6f-41d3-b167-16428bc4b1cc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:26.285940 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9fc02ef-7d6f-41d3-b167-16428bc4b1cc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:26.286647 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9fc02ef-7d6f-41d3-b167-16428bc4b1cc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:26.287620 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9fc02ef-7d6f-41d3-b167-16428bc4b1cc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:26.288243 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9fc02ef-7d6f-41d3-b167-16428bc4b1cc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:26.294105 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a42afa52-8d90-4cfa-8175-9a2c0037229c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:26.304715 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a42afa52-8d90-4cfa-8175-9a2c0037229c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:26.307052 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a42afa52-8d90-4cfa-8175-9a2c0037229c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:26.308481 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a42afa52-8d90-4cfa-8175-9a2c0037229c tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.310347 May 24 15:44:26.309600 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 397/747] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:25 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:26.314998 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-01721775-4c31-4512-8d10-4d0dd4f89f5a req-b21a8053-8f6c-4ec6-a062-828d6aa5f694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a52505-bbe8-48c0-ba6f-ec99a6980285", "name": "network-vif-plugged", "status": "completed", "tag": "f0b68296-7928-4ede-98e0-8adf6abeff09"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:26.323364 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-01721775-4c31-4512-8d10-4d0dd4f89f5a req-b21a8053-8f6c-4ec6-a062-828d6aa5f694 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:26.324081 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-01721775-4c31-4512-8d10-4d0dd4f89f5a req-b21a8053-8f6c-4ec6-a062-828d6aa5f694 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:26.330136 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=100 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:26.338266 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-01721775-4c31-4512-8d10-4d0dd4f89f5a req-b21a8053-8f6c-4ec6-a062-828d6aa5f694 service nova] Creating event network-vif-plugged:f0b68296-7928-4ede-98e0-8adf6abeff09 for instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 on hv-cinder-84315 May 24 15:44:26.345928 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-01721775-4c31-4512-8d10-4d0dd4f89f5a req-b21a8053-8f6c-4ec6-a062-828d6aa5f694 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033873 May 24 15:44:26.346703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 398/748] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:26.369811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-daf73735-eb0f-40da-9779-4cc6b85eb3fa req-8ff1f8da-5411-4c0d-bd81-9be9f5ed90b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e3acf8-2dfa-4628-83d7-e7f1dbfe203f", "tag": "61128d49-e701-4c19-8cbf-602dcf947487"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:26.383744 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-daf73735-eb0f-40da-9779-4cc6b85eb3fa req-8ff1f8da-5411-4c0d-bd81-9be9f5ed90b6 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:26.384527 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-daf73735-eb0f-40da-9779-4cc6b85eb3fa req-8ff1f8da-5411-4c0d-bd81-9be9f5ed90b6 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:26.399581 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-daf73735-eb0f-40da-9779-4cc6b85eb3fa req-8ff1f8da-5411-4c0d-bd81-9be9f5ed90b6 service nova] Creating event network-changed:61128d49-e701-4c19-8cbf-602dcf947487 for instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f on hv-cinder-84315 May 24 15:44:26.410599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-daf73735-eb0f-40da-9779-4cc6b85eb3fa req-8ff1f8da-5411-4c0d-bd81-9be9f5ed90b6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044584 May 24 15:44:26.417704 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 399/749] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:26.525536 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a9fc02ef-7d6f-41d3-b167-16428bc4b1cc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:26.535156 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a9fc02ef-7d6f-41d3-b167-16428bc4b1cc tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1757 microversion: 2.1 time: 0.262018 May 24 15:44:26.535842 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 351/750] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:26 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1757 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:27.291437 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7f12d743-afda-40ec-8910-c9bceb21c635 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:27.292509 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7f12d743-afda-40ec-8910-c9bceb21c635 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:27.301509 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f12d743-afda-40ec-8910-c9bceb21c635 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:27.301948 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f12d743-afda-40ec-8910-c9bceb21c635 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:27.302691 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f12d743-afda-40ec-8910-c9bceb21c635 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:27.303138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f12d743-afda-40ec-8910-c9bceb21c635 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:27.328014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b4dcd283-957e-429c-bca3-9d479c91a78a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:27.328602 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b4dcd283-957e-429c-bca3-9d479c91a78a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:27.335466 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b4dcd283-957e-429c-bca3-9d479c91a78a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:27.335907 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b4dcd283-957e-429c-bca3-9d479c91a78a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:27.336695 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b4dcd283-957e-429c-bca3-9d479c91a78a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:27.337124 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b4dcd283-957e-429c-bca3-9d479c91a78a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:27.494434 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7f12d743-afda-40ec-8910-c9bceb21c635 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:27.503387 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7f12d743-afda-40ec-8910-c9bceb21c635 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.219871 May 24 15:44:27.503946 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 400/751] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:27 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:27.517015 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b4dcd283-957e-429c-bca3-9d479c91a78a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:27.525242 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b4dcd283-957e-429c-bca3-9d479c91a78a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:27.526730 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b4dcd283-957e-429c-bca3-9d479c91a78a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:27.527902 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b4dcd283-957e-429c-bca3-9d479c91a78a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.203867 May 24 15:44:27.528506 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 352/752] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:27 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:27.553225 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-9ef93464-0137-44cc-b26f-06c98688cadf tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:27.553766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-9ef93464-0137-44cc-b26f-06c98688cadf tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:27.559894 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9ef93464-0137-44cc-b26f-06c98688cadf tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:27.560364 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9ef93464-0137-44cc-b26f-06c98688cadf tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:27.561147 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9ef93464-0137-44cc-b26f-06c98688cadf tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:27.561859 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-9ef93464-0137-44cc-b26f-06c98688cadf tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:27.716834 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-9ef93464-0137-44cc-b26f-06c98688cadf tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:27.725003 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-9ef93464-0137-44cc-b26f-06c98688cadf tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1757 microversion: 2.1 time: 0.175946 May 24 15:44:27.725567 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 401/753] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:27 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:28.520898 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5d1f5bf5-1ad0-4d1d-bb50-d51036e40e6d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:28.521512 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5d1f5bf5-1ad0-4d1d-bb50-d51036e40e6d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:28.529018 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5d1f5bf5-1ad0-4d1d-bb50-d51036e40e6d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:28.532233 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5d1f5bf5-1ad0-4d1d-bb50-d51036e40e6d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:28.532943 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5d1f5bf5-1ad0-4d1d-bb50-d51036e40e6d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:28.533552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5d1f5bf5-1ad0-4d1d-bb50-d51036e40e6d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:28.546527 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-95f0f7e1-eaa7-41c8-be06-0133111cf7d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:28.547133 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-95f0f7e1-eaa7-41c8-be06-0133111cf7d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:28.554147 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-95f0f7e1-eaa7-41c8-be06-0133111cf7d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:28.554588 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-95f0f7e1-eaa7-41c8-be06-0133111cf7d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:28.555347 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-95f0f7e1-eaa7-41c8-be06-0133111cf7d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:28.555768 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-95f0f7e1-eaa7-41c8-be06-0133111cf7d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:28.744301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5d1f5bf5-1ad0-4d1d-bb50-d51036e40e6d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:28.751550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-95f0f7e1-eaa7-41c8-be06-0133111cf7d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:28.752271 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5d1f5bf5-1ad0-4d1d-bb50-d51036e40e6d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.235195 May 24 15:44:28.752881 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 353/754] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:28 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:28.757509 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d3753165-8979-42aa-a53e-322a98f0b2af tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:28.758294 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d3753165-8979-42aa-a53e-322a98f0b2af tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:28.763130 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-95f0f7e1-eaa7-41c8-be06-0133111cf7d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:28.764696 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d3753165-8979-42aa-a53e-322a98f0b2af tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:28.764862 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-95f0f7e1-eaa7-41c8-be06-0133111cf7d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:28.765149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d3753165-8979-42aa-a53e-322a98f0b2af tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:28.766249 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d3753165-8979-42aa-a53e-322a98f0b2af tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:28.766684 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d3753165-8979-42aa-a53e-322a98f0b2af tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:28.767012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-95f0f7e1-eaa7-41c8-be06-0133111cf7d0 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1728 microversion: 2.20 time: 0.224084 May 24 15:44:28.767710 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 402/755] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:28 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:28.914932 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d3753165-8979-42aa-a53e-322a98f0b2af tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:28.927248 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d3753165-8979-42aa-a53e-322a98f0b2af tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1757 microversion: 2.1 time: 0.172895 May 24 15:44:28.928072 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 354/756] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:28 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:29.773558 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-37681f29-1584-4d56-bb51-2d2c26a0162a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:29.774543 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-37681f29-1584-4d56-bb51-2d2c26a0162a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:29.784668 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-37681f29-1584-4d56-bb51-2d2c26a0162a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:29.785117 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-37681f29-1584-4d56-bb51-2d2c26a0162a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:29.785879 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-37681f29-1584-4d56-bb51-2d2c26a0162a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:29.786314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-37681f29-1584-4d56-bb51-2d2c26a0162a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:29.787078 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2873845c-5b10-4642-87bc-5caff825a601 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:29.787685 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2873845c-5b10-4642-87bc-5caff825a601 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:29.794528 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2873845c-5b10-4642-87bc-5caff825a601 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:29.794977 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2873845c-5b10-4642-87bc-5caff825a601 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:29.795744 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2873845c-5b10-4642-87bc-5caff825a601 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:29.796211 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2873845c-5b10-4642-87bc-5caff825a601 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:29.979516 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-37681f29-1584-4d56-bb51-2d2c26a0162a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:29.982342 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2873845c-5b10-4642-87bc-5caff825a601 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:29.987653 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-37681f29-1584-4d56-bb51-2d2c26a0162a tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.220783 May 24 15:44:29.988248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 403/757] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:29 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:29.992807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-083aeb89-94d5-4edf-9efe-c9aa53935eee tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:29.993432 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-083aeb89-94d5-4edf-9efe-c9aa53935eee tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:29.995115 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2873845c-5b10-4642-87bc-5caff825a601 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:29.996626 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2873845c-5b10-4642-87bc-5caff825a601 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:29.997868 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2873845c-5b10-4642-87bc-5caff825a601 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1715 microversion: 2.20 time: 0.214705 May 24 15:44:29.998591 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 355/758] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:44:29 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1715 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:44:29.999354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-083aeb89-94d5-4edf-9efe-c9aa53935eee tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:29.999764 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-083aeb89-94d5-4edf-9efe-c9aa53935eee tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:30.000541 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-083aeb89-94d5-4edf-9efe-c9aa53935eee tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:30.000967 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-083aeb89-94d5-4edf-9efe-c9aa53935eee tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:30.161813 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-083aeb89-94d5-4edf-9efe-c9aa53935eee tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:30.175344 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-083aeb89-94d5-4edf-9efe-c9aa53935eee tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1757 microversion: 2.1 time: 0.185932 May 24 15:44:30.176057 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 404/759] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:29 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:31.003979 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-557ed119-16ad-4566-a290-188273442b5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:31.005032 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-557ed119-16ad-4566-a290-188273442b5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:31.012058 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-557ed119-16ad-4566-a290-188273442b5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:31.012534 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-557ed119-16ad-4566-a290-188273442b5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:31.013328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-557ed119-16ad-4566-a290-188273442b5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:31.013751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-557ed119-16ad-4566-a290-188273442b5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:31.151186 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-557ed119-16ad-4566-a290-188273442b5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:31.160277 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-557ed119-16ad-4566-a290-188273442b5f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.160085 May 24 15:44:31.160868 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 356/760] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:30 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:31.196111 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c5633e13-c561-4fee-8cbb-03a37c1fd42e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:31.196719 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c5633e13-c561-4fee-8cbb-03a37c1fd42e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:31.203559 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c5633e13-c561-4fee-8cbb-03a37c1fd42e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:31.204023 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c5633e13-c561-4fee-8cbb-03a37c1fd42e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:31.204825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c5633e13-c561-4fee-8cbb-03a37c1fd42e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:31.205241 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c5633e13-c561-4fee-8cbb-03a37c1fd42e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:31.353731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c5633e13-c561-4fee-8cbb-03a37c1fd42e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:31.366465 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c5633e13-c561-4fee-8cbb-03a37c1fd42e tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1757 microversion: 2.1 time: 0.174032 May 24 15:44:31.367286 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 405/761] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:31 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:32.181459 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-69f8e2d5-67e5-4b4a-af82-70190fbadc7c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:32.182533 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-69f8e2d5-67e5-4b4a-af82-70190fbadc7c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:32.191749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69f8e2d5-67e5-4b4a-af82-70190fbadc7c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:32.192227 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69f8e2d5-67e5-4b4a-af82-70190fbadc7c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:32.192986 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69f8e2d5-67e5-4b4a-af82-70190fbadc7c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:32.193425 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-69f8e2d5-67e5-4b4a-af82-70190fbadc7c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:32.329333 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-69f8e2d5-67e5-4b4a-af82-70190fbadc7c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:32.337355 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-69f8e2d5-67e5-4b4a-af82-70190fbadc7c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.162443 May 24 15:44:32.337925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 357/762] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:32 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:32.387363 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e6c74ae2-f580-4668-a2d6-0671b2095d3a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:32.387927 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e6c74ae2-f580-4668-a2d6-0671b2095d3a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:32.395240 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e6c74ae2-f580-4668-a2d6-0671b2095d3a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:32.395681 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e6c74ae2-f580-4668-a2d6-0671b2095d3a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:32.396473 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e6c74ae2-f580-4668-a2d6-0671b2095d3a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:32.396907 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e6c74ae2-f580-4668-a2d6-0671b2095d3a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:32.543907 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e6c74ae2-f580-4668-a2d6-0671b2095d3a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:32.554093 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e6c74ae2-f580-4668-a2d6-0671b2095d3a tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1757 microversion: 2.1 time: 0.170613 May 24 15:44:32.554679 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 406/763] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:32 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:33.358922 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b51c46b5-b4c3-493e-9816-82a001ab5ad1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:33.359903 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b51c46b5-b4c3-493e-9816-82a001ab5ad1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:33.371651 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b51c46b5-b4c3-493e-9816-82a001ab5ad1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:33.372486 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b51c46b5-b4c3-493e-9816-82a001ab5ad1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:33.373757 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b51c46b5-b4c3-493e-9816-82a001ab5ad1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:33.374483 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b51c46b5-b4c3-493e-9816-82a001ab5ad1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:33.510704 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b51c46b5-b4c3-493e-9816-82a001ab5ad1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:33.522681 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b51c46b5-b4c3-493e-9816-82a001ab5ad1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.170197 May 24 15:44:33.523446 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 358/764] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:33 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:33.579631 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-34ed55f9-8463-4fc8-9a3d-cf7361907909 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:33.580647 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-34ed55f9-8463-4fc8-9a3d-cf7361907909 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:33.591991 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-34ed55f9-8463-4fc8-9a3d-cf7361907909 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:33.593047 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-34ed55f9-8463-4fc8-9a3d-cf7361907909 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:33.594303 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-34ed55f9-8463-4fc8-9a3d-cf7361907909 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:33.595006 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-34ed55f9-8463-4fc8-9a3d-cf7361907909 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:33.752087 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-34ed55f9-8463-4fc8-9a3d-cf7361907909 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:33.764349 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-34ed55f9-8463-4fc8-9a3d-cf7361907909 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1757 microversion: 2.1 time: 0.190907 May 24 15:44:33.765015 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 407/765] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:33 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:34.543721 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e4eccc43-aad4-47a2-8162-cb482147328e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:34.544555 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e4eccc43-aad4-47a2-8162-cb482147328e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:34.547536 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:34.548471 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=8 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:34.555608 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e4eccc43-aad4-47a2-8162-cb482147328e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:34.556056 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e4eccc43-aad4-47a2-8162-cb482147328e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:34.556831 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e4eccc43-aad4-47a2-8162-cb482147328e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:34.557261 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e4eccc43-aad4-47a2-8162-cb482147328e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:34.575214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:34.692162 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e4eccc43-aad4-47a2-8162-cb482147328e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:34.700082 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e4eccc43-aad4-47a2-8162-cb482147328e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.163208 May 24 15:44:34.700658 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 359/766] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:34 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:34.783248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8887792f-1147-4c4c-8a3b-08802c8e2318 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:34.783834 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8887792f-1147-4c4c-8a3b-08802c8e2318 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:34.790972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8887792f-1147-4c4c-8a3b-08802c8e2318 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:34.791412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8887792f-1147-4c4c-8a3b-08802c8e2318 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:34.792203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8887792f-1147-4c4c-8a3b-08802c8e2318 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:34.792622 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8887792f-1147-4c4c-8a3b-08802c8e2318 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:34.938400 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-8887792f-1147-4c4c-8a3b-08802c8e2318 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:34.947082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8887792f-1147-4c4c-8a3b-08802c8e2318 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1760 microversion: 2.1 time: 0.168068 May 24 15:44:34.947622 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 408/767] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:34 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:35.717674 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f1a87a91-c4fc-4f46-8fd4-44ccb40c75d1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:35.718343 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f1a87a91-c4fc-4f46-8fd4-44ccb40c75d1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:35.720608 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:35.728177 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f1a87a91-c4fc-4f46-8fd4-44ccb40c75d1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:35.728944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f1a87a91-c4fc-4f46-8fd4-44ccb40c75d1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:35.730293 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f1a87a91-c4fc-4f46-8fd4-44ccb40c75d1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:35.730949 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f1a87a91-c4fc-4f46-8fd4-44ccb40c75d1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:35.873484 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f1a87a91-c4fc-4f46-8fd4-44ccb40c75d1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:35.882733 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f1a87a91-c4fc-4f46-8fd4-44ccb40c75d1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.169312 May 24 15:44:35.883299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 360/768] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:35 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:36.900401 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3282431c-3d60-4967-870e-8a7cb9376319 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:36.900994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3282431c-3d60-4967-870e-8a7cb9376319 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:36.903486 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:36.908831 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3282431c-3d60-4967-870e-8a7cb9376319 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:36.909268 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3282431c-3d60-4967-870e-8a7cb9376319 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:36.910016 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3282431c-3d60-4967-870e-8a7cb9376319 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:36.910440 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3282431c-3d60-4967-870e-8a7cb9376319 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:37.041755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3282431c-3d60-4967-870e-8a7cb9376319 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:37.050463 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3282431c-3d60-4967-870e-8a7cb9376319 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.153963 May 24 15:44:37.051193 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 409/769] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:36 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:44:37.565429 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6da6d8eb-eb9c-4c64-8c3e-3e40f2d9fd87 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:37.565938 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6da6d8eb-eb9c-4c64-8c3e-3e40f2d9fd87 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:37.573348 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6da6d8eb-eb9c-4c64-8c3e-3e40f2d9fd87 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:37.573804 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6da6d8eb-eb9c-4c64-8c3e-3e40f2d9fd87 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:37.574670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6da6d8eb-eb9c-4c64-8c3e-3e40f2d9fd87 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:37.575010 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6da6d8eb-eb9c-4c64-8c3e-3e40f2d9fd87 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:37.600896 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6da6d8eb-eb9c-4c64-8c3e-3e40f2d9fd87 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/ips" status: 200 len: 146 microversion: 2.1 time: 0.039574 May 24 15:44:37.601492 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 361/770] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 24 15:44:37 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:38.071423 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ac2858a8-4994-43c1-92af-1d16d0e6dda6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:38.072135 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ac2858a8-4994-43c1-92af-1d16d0e6dda6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:38.080681 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ac2858a8-4994-43c1-92af-1d16d0e6dda6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:38.081238 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ac2858a8-4994-43c1-92af-1d16d0e6dda6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:38.082184 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ac2858a8-4994-43c1-92af-1d16d0e6dda6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:38.082812 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ac2858a8-4994-43c1-92af-1d16d0e6dda6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:38.230584 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ac2858a8-4994-43c1-92af-1d16d0e6dda6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:38.238109 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ac2858a8-4994-43c1-92af-1d16d0e6dda6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.172464 May 24 15:44:38.238672 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 410/771] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:38 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:38.335350 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-0c4c4edb-4747-4f79-846c-612ac356c9ea req-24545544-0f3a-4262-a884-d590dfadda4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e3acf8-2dfa-4628-83d7-e7f1dbfe203f", "name": "network-vif-plugged", "status": "completed", "tag": "61128d49-e701-4c19-8cbf-602dcf947487"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:38.343587 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-0c4c4edb-4747-4f79-846c-612ac356c9ea req-24545544-0f3a-4262-a884-d590dfadda4d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:38.344104 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-0c4c4edb-4747-4f79-846c-612ac356c9ea req-24545544-0f3a-4262-a884-d590dfadda4d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:38.356755 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-0c4c4edb-4747-4f79-846c-612ac356c9ea req-24545544-0f3a-4262-a884-d590dfadda4d service nova] Creating event network-vif-plugged:61128d49-e701-4c19-8cbf-602dcf947487 for instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f on hv-cinder-84315 May 24 15:44:38.362191 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-0c4c4edb-4747-4f79-846c-612ac356c9ea req-24545544-0f3a-4262-a884-d590dfadda4d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030982 May 24 15:44:38.362781 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 362/772] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:39.259683 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7060542c-c8fc-4bd6-bad2-4819b44c7042 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:39.260723 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7060542c-c8fc-4bd6-bad2-4819b44c7042 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:39.272455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7060542c-c8fc-4bd6-bad2-4819b44c7042 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:39.273203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7060542c-c8fc-4bd6-bad2-4819b44c7042 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:39.274467 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7060542c-c8fc-4bd6-bad2-4819b44c7042 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:39.275194 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7060542c-c8fc-4bd6-bad2-4819b44c7042 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:39.419161 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7060542c-c8fc-4bd6-bad2-4819b44c7042 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:39.426995 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7060542c-c8fc-4bd6-bad2-4819b44c7042 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1266 microversion: 2.1 time: 0.174052 May 24 15:44:39.427533 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 411/773] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:39 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:40.445268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a0a7ac9a-a766-43c0-bbc8-b2cfa586fb41 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:40.445986 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a0a7ac9a-a766-43c0-bbc8-b2cfa586fb41 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:40.452646 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a0a7ac9a-a766-43c0-bbc8-b2cfa586fb41 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:40.453021 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a0a7ac9a-a766-43c0-bbc8-b2cfa586fb41 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:40.453780 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a0a7ac9a-a766-43c0-bbc8-b2cfa586fb41 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:40.454213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a0a7ac9a-a766-43c0-bbc8-b2cfa586fb41 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:40.596288 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a0a7ac9a-a766-43c0-bbc8-b2cfa586fb41 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:40.604208 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a0a7ac9a-a766-43c0-bbc8-b2cfa586fb41 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1452 microversion: 2.1 time: 0.163869 May 24 15:44:40.604775 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 363/774] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:40 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:40.623129 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-85345595-9c89-4f4d-bbae-fa25f953843e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:40.623726 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-85345595-9c89-4f4d-bbae-fa25f953843e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:40.630572 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-85345595-9c89-4f4d-bbae-fa25f953843e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:40.631017 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-85345595-9c89-4f4d-bbae-fa25f953843e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:40.631832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-85345595-9c89-4f4d-bbae-fa25f953843e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:40.632382 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-85345595-9c89-4f4d-bbae-fa25f953843e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:40.759240 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-89cc9e47-a45e-43b1-a8da-b57ff80623d5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f11cbb9-8be9-4bbb-a4b6-a525f6670c13"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:40.760345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-89cc9e47-a45e-43b1-a8da-b57ff80623d5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:40.766894 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-89cc9e47-a45e-43b1-a8da-b57ff80623d5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:40.767338 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-89cc9e47-a45e-43b1-a8da-b57ff80623d5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:40.767658 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-85345595-9c89-4f4d-bbae-fa25f953843e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:40.768131 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-89cc9e47-a45e-43b1-a8da-b57ff80623d5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:40.768562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-89cc9e47-a45e-43b1-a8da-b57ff80623d5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:40.775285 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-85345595-9c89-4f4d-bbae-fa25f953843e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1452 microversion: 2.1 time: 0.156087 May 24 15:44:40.776002 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 412/775] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:40 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:41.039128 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-89cc9e47-a45e-43b1-a8da-b57ff80623d5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283675 May 24 15:44:41.040190 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 364/776] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:44:40 2022] POST /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:42.433993 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-178e759f-40db-4ae8-ac1e-b67323969058 req-9f107982-ccf8-432f-9b99-1e941829f0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e3acf8-2dfa-4628-83d7-e7f1dbfe203f", "tag": "61128d49-e701-4c19-8cbf-602dcf947487"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:42.442775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-178e759f-40db-4ae8-ac1e-b67323969058 req-9f107982-ccf8-432f-9b99-1e941829f0e1 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:42.443230 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-178e759f-40db-4ae8-ac1e-b67323969058 req-9f107982-ccf8-432f-9b99-1e941829f0e1 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:42.454239 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-178e759f-40db-4ae8-ac1e-b67323969058 req-9f107982-ccf8-432f-9b99-1e941829f0e1 service nova] Creating event network-changed:61128d49-e701-4c19-8cbf-602dcf947487 for instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f on hv-cinder-84315 May 24 15:44:42.459306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-178e759f-40db-4ae8-ac1e-b67323969058 req-9f107982-ccf8-432f-9b99-1e941829f0e1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029017 May 24 15:44:42.459885 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 413/777] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:44:48.604600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3330e459-76b5-4986-ad24-2e4707b8cb1c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:48.612390 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3330e459-76b5-4986-ad24-2e4707b8cb1c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:48.612854 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3330e459-76b5-4986-ad24-2e4707b8cb1c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:48.672180 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3330e459-76b5-4986-ad24-2e4707b8cb1c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Going to try to stop instance {{(pid=129339) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 24 15:44:48.719959 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3330e459-76b5-4986-ad24-2e4707b8cb1c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/action" status: 202 len: 0 microversion: 2.1 time: 0.119194 May 24 15:44:48.720961 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 365/778] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:44:48 2022] POST /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:44:48.730604 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a1f1e8a7-6979-43ab-8cf9-70ae58974ef6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:48.731174 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a1f1e8a7-6979-43ab-8cf9-70ae58974ef6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:48.738692 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a1f1e8a7-6979-43ab-8cf9-70ae58974ef6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:48.739316 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a1f1e8a7-6979-43ab-8cf9-70ae58974ef6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:48.740329 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a1f1e8a7-6979-43ab-8cf9-70ae58974ef6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:48.740796 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a1f1e8a7-6979-43ab-8cf9-70ae58974ef6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:48.873762 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a1f1e8a7-6979-43ab-8cf9-70ae58974ef6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:48.882217 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a1f1e8a7-6979-43ab-8cf9-70ae58974ef6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1723 microversion: 2.1 time: 0.156821 May 24 15:44:48.882792 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 414/779] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:48 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:49.905392 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9aaf2191-8d52-4cd1-ab51-ca2b3ca9bdf0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:49.906534 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9aaf2191-8d52-4cd1-ab51-ca2b3ca9bdf0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:49.915311 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9aaf2191-8d52-4cd1-ab51-ca2b3ca9bdf0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:49.915758 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9aaf2191-8d52-4cd1-ab51-ca2b3ca9bdf0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:49.916558 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9aaf2191-8d52-4cd1-ab51-ca2b3ca9bdf0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:49.916985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9aaf2191-8d52-4cd1-ab51-ca2b3ca9bdf0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:50.049005 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9aaf2191-8d52-4cd1-ab51-ca2b3ca9bdf0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:50.057692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9aaf2191-8d52-4cd1-ab51-ca2b3ca9bdf0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1723 microversion: 2.1 time: 0.159361 May 24 15:44:50.058268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 366/780] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:49 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:51.077944 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-490f2887-9258-45fd-8460-98a3061752ff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:51.078700 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-490f2887-9258-45fd-8460-98a3061752ff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:51.086636 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-490f2887-9258-45fd-8460-98a3061752ff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:51.087083 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-490f2887-9258-45fd-8460-98a3061752ff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:51.087851 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-490f2887-9258-45fd-8460-98a3061752ff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:51.088326 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-490f2887-9258-45fd-8460-98a3061752ff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:51.235177 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-490f2887-9258-45fd-8460-98a3061752ff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:51.247606 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-490f2887-9258-45fd-8460-98a3061752ff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1723 microversion: 2.1 time: 0.174829 May 24 15:44:51.248622 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 415/781] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:51 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:52.269820 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bb36ceb2-81ac-4cf6-8949-cec836f127f6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:52.271126 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bb36ceb2-81ac-4cf6-8949-cec836f127f6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:52.282648 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bb36ceb2-81ac-4cf6-8949-cec836f127f6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:52.283380 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bb36ceb2-81ac-4cf6-8949-cec836f127f6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:52.284786 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bb36ceb2-81ac-4cf6-8949-cec836f127f6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:52.285638 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bb36ceb2-81ac-4cf6-8949-cec836f127f6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:52.437681 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bb36ceb2-81ac-4cf6-8949-cec836f127f6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:52.449610 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bb36ceb2-81ac-4cf6-8949-cec836f127f6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1723 microversion: 2.1 time: 0.186328 May 24 15:44:52.450271 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 367/782] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:52 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:53.471825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0f23dc09-de71-4a1c-90e1-a221df5e9595 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:53.472820 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0f23dc09-de71-4a1c-90e1-a221df5e9595 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:53.480712 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0f23dc09-de71-4a1c-90e1-a221df5e9595 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:53.481156 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0f23dc09-de71-4a1c-90e1-a221df5e9595 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:53.481906 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0f23dc09-de71-4a1c-90e1-a221df5e9595 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:53.482331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0f23dc09-de71-4a1c-90e1-a221df5e9595 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:53.638087 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0f23dc09-de71-4a1c-90e1-a221df5e9595 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:53.640811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=100 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:44:53.648306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0f23dc09-de71-4a1c-90e1-a221df5e9595 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1723 microversion: 2.1 time: 0.182952 May 24 15:44:53.648903 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 416/783] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:53 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:54.674649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c60481fb-41a0-46b3-bdb6-409f484dc201 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:54.675507 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c60481fb-41a0-46b3-bdb6-409f484dc201 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:54.682765 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c60481fb-41a0-46b3-bdb6-409f484dc201 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:54.683209 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c60481fb-41a0-46b3-bdb6-409f484dc201 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:54.683971 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c60481fb-41a0-46b3-bdb6-409f484dc201 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:54.684424 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c60481fb-41a0-46b3-bdb6-409f484dc201 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:54.817651 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c60481fb-41a0-46b3-bdb6-409f484dc201 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:54.826224 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c60481fb-41a0-46b3-bdb6-409f484dc201 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1723 microversion: 2.1 time: 0.158138 May 24 15:44:54.826757 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 368/784] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:54 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:55.846057 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-25a33123-f3e5-4108-94ee-4d343832bf99 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:55.846912 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-25a33123-f3e5-4108-94ee-4d343832bf99 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:55.854493 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-25a33123-f3e5-4108-94ee-4d343832bf99 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:55.854941 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-25a33123-f3e5-4108-94ee-4d343832bf99 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:55.855705 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-25a33123-f3e5-4108-94ee-4d343832bf99 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:55.856177 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-25a33123-f3e5-4108-94ee-4d343832bf99 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:55.994942 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-25a33123-f3e5-4108-94ee-4d343832bf99 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:56.002994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-25a33123-f3e5-4108-94ee-4d343832bf99 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1723 microversion: 2.1 time: 0.163124 May 24 15:44:56.003571 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 417/785] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:55 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:57.024403 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-26613fb9-94d5-47aa-89a1-1bde718250d8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:57.025145 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-26613fb9-94d5-47aa-89a1-1bde718250d8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:57.034123 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-26613fb9-94d5-47aa-89a1-1bde718250d8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:57.034705 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-26613fb9-94d5-47aa-89a1-1bde718250d8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:57.035704 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-26613fb9-94d5-47aa-89a1-1bde718250d8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:57.036328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-26613fb9-94d5-47aa-89a1-1bde718250d8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:57.172363 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-26613fb9-94d5-47aa-89a1-1bde718250d8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:57.181052 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-26613fb9-94d5-47aa-89a1-1bde718250d8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1723 microversion: 2.1 time: 0.162204 May 24 15:44:57.181651 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 369/786] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:57 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:58.198691 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-52055750-e6f1-4cdc-bebf-ed65d3373677 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:58.199382 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-52055750-e6f1-4cdc-bebf-ed65d3373677 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:58.206630 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-52055750-e6f1-4cdc-bebf-ed65d3373677 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:58.207116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-52055750-e6f1-4cdc-bebf-ed65d3373677 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:58.208014 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-52055750-e6f1-4cdc-bebf-ed65d3373677 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:58.208471 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-52055750-e6f1-4cdc-bebf-ed65d3373677 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:58.345840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-52055750-e6f1-4cdc-bebf-ed65d3373677 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:58.354063 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-52055750-e6f1-4cdc-bebf-ed65d3373677 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1723 microversion: 2.1 time: 0.159269 May 24 15:44:58.354634 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 418/787] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:58 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:59.378854 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-fb40f0ca-2f5e-4fd1-844e-343fe05b236c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:59.380207 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-fb40f0ca-2f5e-4fd1-844e-343fe05b236c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:59.391569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fb40f0ca-2f5e-4fd1-844e-343fe05b236c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:59.392346 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fb40f0ca-2f5e-4fd1-844e-343fe05b236c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:59.393588 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fb40f0ca-2f5e-4fd1-844e-343fe05b236c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:59.394291 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fb40f0ca-2f5e-4fd1-844e-343fe05b236c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:59.521281 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-fb40f0ca-2f5e-4fd1-844e-343fe05b236c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:59.529586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-fb40f0ca-2f5e-4fd1-844e-343fe05b236c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1700 microversion: 2.1 time: 0.157234 May 24 15:44:59.530122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 370/788] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:59 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:44:59.546699 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8d8e35ce-65c3-4ce9-8ca1-778e5b372ebd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:44:59.553578 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8d8e35ce-65c3-4ce9-8ca1-778e5b372ebd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:59.554011 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8d8e35ce-65c3-4ce9-8ca1-778e5b372ebd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:59.619630 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8d8e35ce-65c3-4ce9-8ca1-778e5b372ebd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Going to try to start instance {{(pid=129340) start /opt/stack/nova/nova/compute/api.py:2730}} May 24 15:44:59.668644 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8d8e35ce-65c3-4ce9-8ca1-778e5b372ebd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/action" status: 202 len: 0 microversion: 2.1 time: 0.125542 May 24 15:44:59.669392 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 419/789] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:44:59 2022] POST /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 15:44:59.677720 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c2a370af-937c-450a-83a5-c7dbf6cfa373 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:44:59.678328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c2a370af-937c-450a-83a5-c7dbf6cfa373 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:44:59.684575 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c2a370af-937c-450a-83a5-c7dbf6cfa373 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:59.684991 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c2a370af-937c-450a-83a5-c7dbf6cfa373 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:59.685744 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c2a370af-937c-450a-83a5-c7dbf6cfa373 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:44:59.686169 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c2a370af-937c-450a-83a5-c7dbf6cfa373 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:44:59.820972 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c2a370af-937c-450a-83a5-c7dbf6cfa373 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:44:59.829082 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c2a370af-937c-450a-83a5-c7dbf6cfa373 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1709 microversion: 2.1 time: 0.155194 May 24 15:44:59.829663 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 371/790] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:44:59 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:00.852141 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2d2432d3-112c-43a9-9fb0-859e68355773 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:00.853373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2d2432d3-112c-43a9-9fb0-859e68355773 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:00.866370 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2d2432d3-112c-43a9-9fb0-859e68355773 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:00.866830 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2d2432d3-112c-43a9-9fb0-859e68355773 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:00.867651 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2d2432d3-112c-43a9-9fb0-859e68355773 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:00.868061 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2d2432d3-112c-43a9-9fb0-859e68355773 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:01.006539 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2d2432d3-112c-43a9-9fb0-859e68355773 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:01.015343 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2d2432d3-112c-43a9-9fb0-859e68355773 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1709 microversion: 2.1 time: 0.171024 May 24 15:45:01.015910 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 420/791] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:00 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1709 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:02.033134 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5298ad6b-776e-44f1-839f-720232cd7721 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:02.033743 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5298ad6b-776e-44f1-839f-720232cd7721 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:02.040936 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5298ad6b-776e-44f1-839f-720232cd7721 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:02.041389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5298ad6b-776e-44f1-839f-720232cd7721 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:02.042159 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5298ad6b-776e-44f1-839f-720232cd7721 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:02.042589 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5298ad6b-776e-44f1-839f-720232cd7721 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:02.175343 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5298ad6b-776e-44f1-839f-720232cd7721 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:02.184198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5298ad6b-776e-44f1-839f-720232cd7721 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1713 microversion: 2.1 time: 0.154912 May 24 15:45:02.184901 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 372/792] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:02 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:03.327047 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a80a650b-e79d-4b89-b222-695eea90c44a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:03.328068 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a80a650b-e79d-4b89-b222-695eea90c44a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:03.334715 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a80a650b-e79d-4b89-b222-695eea90c44a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:03.335145 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a80a650b-e79d-4b89-b222-695eea90c44a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:03.335915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a80a650b-e79d-4b89-b222-695eea90c44a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:03.336386 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a80a650b-e79d-4b89-b222-695eea90c44a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:03.365074 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a80a650b-e79d-4b89-b222-695eea90c44a tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042048 May 24 15:45:03.365621 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 421/793] 10.222.0.55 () {60 vars in 1342 bytes} [Tue May 24 15:45:03 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:03.431919 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f3bf4135-3c5e-434c-9951-d546d7fba668 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:03.432460 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f3bf4135-3c5e-434c-9951-d546d7fba668 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:03.439026 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3bf4135-3c5e-434c-9951-d546d7fba668 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:03.439468 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3bf4135-3c5e-434c-9951-d546d7fba668 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:03.440241 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3bf4135-3c5e-434c-9951-d546d7fba668 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:03.440670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3bf4135-3c5e-434c-9951-d546d7fba668 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:03.465268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f3bf4135-3c5e-434c-9951-d546d7fba668 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:45:03.499898 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:03.548915 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f3bf4135-3c5e-434c-9951-d546d7fba668 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "DELETE /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 204 len: 0 microversion: 2.20 time: 0.120303 May 24 15:45:03.549883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 373/794] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 24 15:45:03 2022] DELETE /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 15:45:03.558466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-424cbfcf-1cda-4d2c-bedd-3a238c5b8c7e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:03.559154 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-424cbfcf-1cda-4d2c-bedd-3a238c5b8c7e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:03.565845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-424cbfcf-1cda-4d2c-bedd-3a238c5b8c7e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:03.566612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-424cbfcf-1cda-4d2c-bedd-3a238c5b8c7e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:03.567378 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-424cbfcf-1cda-4d2c-bedd-3a238c5b8c7e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:03.567802 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-424cbfcf-1cda-4d2c-bedd-3a238c5b8c7e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:03.710000 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-424cbfcf-1cda-4d2c-bedd-3a238c5b8c7e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:03.718104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-424cbfcf-1cda-4d2c-bedd-3a238c5b8c7e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:03.719582 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-424cbfcf-1cda-4d2c-bedd-3a238c5b8c7e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:03.720809 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-424cbfcf-1cda-4d2c-bedd-3a238c5b8c7e tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.166230 May 24 15:45:03.721358 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 422/795] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:45:03 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:45:04.745066 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e753905d-8d37-4396-ac1d-0e904449a822 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:04.746214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e753905d-8d37-4396-ac1d-0e904449a822 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:04.755960 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e753905d-8d37-4396-ac1d-0e904449a822 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:04.756415 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e753905d-8d37-4396-ac1d-0e904449a822 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:04.757176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e753905d-8d37-4396-ac1d-0e904449a822 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:04.757606 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e753905d-8d37-4396-ac1d-0e904449a822 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:04.894107 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e753905d-8d37-4396-ac1d-0e904449a822 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:04.906925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e753905d-8d37-4396-ac1d-0e904449a822 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:04.909234 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e753905d-8d37-4396-ac1d-0e904449a822 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:04.910966 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e753905d-8d37-4396-ac1d-0e904449a822 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1721 microversion: 2.20 time: 0.173111 May 24 15:45:04.911558 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 374/796] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:45:04 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:45:05.935539 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f63bc49e-4b95-4c4c-a7a3-73dfe63d1665 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:05.936107 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f63bc49e-4b95-4c4c-a7a3-73dfe63d1665 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:05.944842 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f63bc49e-4b95-4c4c-a7a3-73dfe63d1665 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:05.945361 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f63bc49e-4b95-4c4c-a7a3-73dfe63d1665 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:05.946121 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f63bc49e-4b95-4c4c-a7a3-73dfe63d1665 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:05.946544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f63bc49e-4b95-4c4c-a7a3-73dfe63d1665 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:06.013052 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f63bc49e-4b95-4c4c-a7a3-73dfe63d1665 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:06.021971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f63bc49e-4b95-4c4c-a7a3-73dfe63d1665 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:06.023440 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f63bc49e-4b95-4c4c-a7a3-73dfe63d1665 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bb20bf4c31d44ac9dd9ef0db9a2a63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0613f4cbb3461a982738c683c3ab03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:06.024608 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f63bc49e-4b95-4c4c-a7a3-73dfe63d1665 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 200 len: 1654 microversion: 2.20 time: 0.093332 May 24 15:45:06.025136 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 423/797] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:45:05 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 1654 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 15:45:06.103673 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-62fa5773-4ef4-4939-95da-be4a0e8a0d2c req-8a610cc0-1eff-4791-bf36-d9c47a0fdae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a52505-bbe8-48c0-ba6f-ec99a6980285", "name": "network-vif-deleted", "tag": "f0b68296-7928-4ede-98e0-8adf6abeff09"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:06.108261 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:06.113853 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-62fa5773-4ef4-4939-95da-be4a0e8a0d2c req-8a610cc0-1eff-4791-bf36-d9c47a0fdae9 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:06.114286 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-62fa5773-4ef4-4939-95da-be4a0e8a0d2c req-8a610cc0-1eff-4791-bf36-d9c47a0fdae9 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:06.127283 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-62fa5773-4ef4-4939-95da-be4a0e8a0d2c req-8a610cc0-1eff-4791-bf36-d9c47a0fdae9 service nova] Creating event network-vif-deleted:f0b68296-7928-4ede-98e0-8adf6abeff09 for instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 on hv-cinder-84315 May 24 15:45:06.133213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-62fa5773-4ef4-4939-95da-be4a0e8a0d2c req-8a610cc0-1eff-4791-bf36-d9c47a0fdae9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033220 May 24 15:45:06.133820 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 375/798] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:45:07.043031 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a520c024-2203-4e26-95a9-ea18be6c5773 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:07.044371 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a520c024-2203-4e26-95a9-ea18be6c5773 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:07.051224 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=30 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:07.053436 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a520c024-2203-4e26-95a9-ea18be6c5773 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:07.054173 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a520c024-2203-4e26-95a9-ea18be6c5773 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:07.055199 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a520c024-2203-4e26-95a9-ea18be6c5773 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:07.055633 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a520c024-2203-4e26-95a9-ea18be6c5773 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:07.069837 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-a520c024-2203-4e26-95a9-ea18be6c5773 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] HTTP exception thrown: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a520c024-2203-4e26-95a9-ea18be6c5773 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Request method failure captured: May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 HTTP/1.1 May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPvlMf_TuVuU3ml656y9qWN5PZ9OXLyRaJg35cJvYg2U9lsF-flvXfpzIWv_yVoYIo6EWdRP18y3gbsOYbc7RhH_gFy-GaYPWlCi8CZeVOl7E96PniY4k2XV5SOquOoB-Ca3KwQFpGIx5_Lh9m57fab7E7AYq_3oJq1e_Fy_A-VjPRg May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:45:07.071477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 9bb20bf4c31d44ac9dd9ef0db9a2a63a May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:07.073299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '92a52505-bbe8-48c0-ba6f-ec99a6980285'} May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:45:07.074099 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:07.075380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:07.077566 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a520c024-2203-4e26-95a9-ea18be6c5773 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Returning 404 to user: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:45:07.077566 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a520c024-2203-4e26-95a9-ea18be6c5773 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 404 len: 111 microversion: 2.20 time: 0.033834 May 24 15:45:07.077566 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 424/799] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:45:07 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 15:45:07.082567 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-942d407d-3113-43b5-8c28-8bd1c18da671 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '.version_select at 0x7fb1d5145d30>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:07.102138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-942d407d-3113-43b5-8c28-8bd1c18da671 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-131312774" status: 204 len: 0 microversion: 2.20 time: 0.023804 May 24 15:45:07.102919 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 376/800] 10.222.0.55 () {60 vars in 1258 bytes} [Tue May 24 15:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-131312774 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 24 15:45:08.870652 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-00d40610-fb74-4eee-83b6-878d8e4d36a1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:08.871178 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-00d40610-fb74-4eee-83b6-878d8e4d36a1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:08.877941 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-00d40610-fb74-4eee-83b6-878d8e4d36a1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:08.878383 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-00d40610-fb74-4eee-83b6-878d8e4d36a1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:08.879165 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-00d40610-fb74-4eee-83b6-878d8e4d36a1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:08.879595 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-00d40610-fb74-4eee-83b6-878d8e4d36a1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:08.896780 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-00d40610-fb74-4eee-83b6-878d8e4d36a1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] HTTP exception thrown: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-00d40610-fb74-4eee-83b6-878d8e4d36a1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Request method failure captured: May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: DELETE /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 HTTP/1.1 May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPvlMf_TuVuU3ml656y9qWN5PZ9OXLyRaJg35cJvYg2U9lsF-flvXfpzIWv_yVoYIo6EWdRP18y3gbsOYbc7RhH_gFy-GaYPWlCi8CZeVOl7E96PniY4k2XV5SOquOoB-Ca3KwQFpGIx5_Lh9m57fab7E7AYq_3oJq1e_Fy_A-VjPRg May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:45:08.898336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 9bb20bf4c31d44ac9dd9ef0db9a2a63a May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:08.900116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '92a52505-bbe8-48c0-ba6f-ec99a6980285'} May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:45:08.900880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:08.902355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:08.903808 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-00d40610-fb74-4eee-83b6-878d8e4d36a1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Returning 404 to user: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:45:08.903808 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-00d40610-fb74-4eee-83b6-878d8e4d36a1 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "DELETE /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 404 len: 111 microversion: 2.20 time: 0.032995 May 24 15:45:08.903808 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 425/801] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 24 15:45:08 2022] DELETE /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 15:45:08.908888 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1f7bc000-ced1-4b71-86aa-095a4f043bb3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:08.909614 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1f7bc000-ced1-4b71-86aa-095a4f043bb3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: 92a52505-bbe8-48c0-ba6f-ec99a6980285] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:08.916232 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1f7bc000-ced1-4b71-86aa-095a4f043bb3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:08.916675 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1f7bc000-ced1-4b71-86aa-095a4f043bb3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:08.917424 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1f7bc000-ced1-4b71-86aa-095a4f043bb3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:08.917850 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1f7bc000-ced1-4b71-86aa-095a4f043bb3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:08.931292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-1f7bc000-ced1-4b71-86aa-095a4f043bb3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] HTTP exception thrown: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1f7bc000-ced1-4b71-86aa-095a4f043bb3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Request method failure captured: May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 HTTP/1.1 May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPvlMf_TuVuU3ml656y9qWN5PZ9OXLyRaJg35cJvYg2U9lsF-flvXfpzIWv_yVoYIo6EWdRP18y3gbsOYbc7RhH_gFy-GaYPWlCi8CZeVOl7E96PniY4k2XV5SOquOoB-Ca3KwQFpGIx5_Lh9m57fab7E7AYq_3oJq1e_Fy_A-VjPRg May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:45:08.933003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 9bb20bf4c31d44ac9dd9ef0db9a2a63a May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:08.934612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': '92a52505-bbe8-48c0-ba6f-ec99a6980285'} May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:45:08.935508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. May 24 15:45:08.937003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:45:08.938422 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1f7bc000-ced1-4b71-86aa-095a4f043bb3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Returning 404 to user: Instance 92a52505-bbe8-48c0-ba6f-ec99a6980285 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:45:08.938422 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1f7bc000-ced1-4b71-86aa-095a4f043bb3 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285" status: 404 len: 111 microversion: 2.20 time: 0.029924 May 24 15:45:08.938422 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 377/802] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:45:08 2022] GET /compute/v2.1/servers/92a52505-bbe8-48c0-ba6f-ec99a6980285 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 15:45:10.082962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d4c060ff-c71f-4f05-b481-eaf6c70f18c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:10.083502 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d4c060ff-c71f-4f05-b481-eaf6c70f18c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:10.090693 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d4c060ff-c71f-4f05-b481-eaf6c70f18c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:10.091181 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d4c060ff-c71f-4f05-b481-eaf6c70f18c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:10.091935 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d4c060ff-c71f-4f05-b481-eaf6c70f18c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:10.092396 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d4c060ff-c71f-4f05-b481-eaf6c70f18c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:10.106182 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-d4c060ff-c71f-4f05-b481-eaf6c70f18c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] HTTP exception thrown: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d4c060ff-c71f-4f05-b481-eaf6c70f18c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Request method failure captured: May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: DELETE /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a HTTP/1.1 May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPvlMf_TuVuU3ml656y9qWN5PZ9OXLyRaJg35cJvYg2U9lsF-flvXfpzIWv_yVoYIo6EWdRP18y3gbsOYbc7RhH_gFy-GaYPWlCi8CZeVOl7E96PniY4k2XV5SOquOoB-Ca3KwQFpGIx5_Lh9m57fab7E7AYq_3oJq1e_Fy_A-VjPRg May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:45:10.107714 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 9bb20bf4c31d44ac9dd9ef0db9a2a63a May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:45:10.109342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'ca2694ac-4a5e-4cfa-aaf8-877c8285148a'} May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:45:10.110203 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:45:10.111557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:10.113398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d4c060ff-c71f-4f05-b481-eaf6c70f18c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Returning 404 to user: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:45:10.113398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d4c060ff-c71f-4f05-b481-eaf6c70f18c7 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 404 len: 111 microversion: 2.20 time: 0.030248 May 24 15:45:10.113398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 426/803] 10.222.0.55 () {60 vars in 1279 bytes} [Tue May 24 15:45:10 2022] DELETE /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 15:45:10.117973 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7b5f49df-11b3-4b30-8649-3b114f07b1c9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:10.118575 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7b5f49df-11b3-4b30-8649-3b114f07b1c9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] [instance: ca2694ac-4a5e-4cfa-aaf8-877c8285148a] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:10.125510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b5f49df-11b3-4b30-8649-3b114f07b1c9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:10.125954 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b5f49df-11b3-4b30-8649-3b114f07b1c9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:10.126699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b5f49df-11b3-4b30-8649-3b114f07b1c9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:10.127124 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7b5f49df-11b3-4b30-8649-3b114f07b1c9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:10.140932 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-7b5f49df-11b3-4b30-8649-3b114f07b1c9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] HTTP exception thrown: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7b5f49df-11b3-4b30-8649-3b114f07b1c9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Request method failure captured: May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a HTTP/1.1 May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPvlMf_TuVuU3ml656y9qWN5PZ9OXLyRaJg35cJvYg2U9lsF-flvXfpzIWv_yVoYIo6EWdRP18y3gbsOYbc7RhH_gFy-GaYPWlCi8CZeVOl7E96PniY4k2XV5SOquOoB-Ca3KwQFpGIx5_Lh9m57fab7E7AYq_3oJq1e_Fy_A-VjPRg May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Openstack-Nova-Api-Version: 2.20 May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:45:10.142449 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd0613f4cbb3461a982738c683c3ab03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: fd0613f4cbb3461a982738c683c3ab03 May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2084526134 May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 9bb20bf4c31d44ac9dd9ef0db9a2a63a May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2084526134-project May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:45:10.143864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'ca2694ac-4a5e-4cfa-aaf8-877c8285148a'} May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:45:10.144871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. May 24 15:45:10.146273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:45:10.147369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7b5f49df-11b3-4b30-8649-3b114f07b1c9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] Returning 404 to user: Instance ca2694ac-4a5e-4cfa-aaf8-877c8285148a could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:45:10.147369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7b5f49df-11b3-4b30-8649-3b114f07b1c9 tempest-AttachVolumeShelveTestJSON-2084526134 tempest-AttachVolumeShelveTestJSON-2084526134-project] 10.222.0.55 "GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a" status: 404 len: 111 microversion: 2.20 time: 0.029835 May 24 15:45:10.147369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 378/804] 10.222.0.55 () {60 vars in 1276 bytes} [Tue May 24 15:45:10 2022] GET /compute/v2.1/servers/ca2694ac-4a5e-4cfa-aaf8-877c8285148a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 15:45:13.217864 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8bd66987-953b-4c13-806f-7f6feb5cd883 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2083163814"}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:13.218456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8bd66987-953b-4c13-806f-7f6feb5cd883 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:13.226662 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8bd66987-953b-4c13-806f-7f6feb5cd883 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:13.227152 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8bd66987-953b-4c13-806f-7f6feb5cd883 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:13.227922 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8bd66987-953b-4c13-806f-7f6feb5cd883 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:13.228394 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8bd66987-953b-4c13-806f-7f6feb5cd883 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:13.381265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.network.security_group_api [None req-8bd66987-953b-4c13-806f-7f6feb5cd883 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Removing security group 04b37776-5d25-409b-a268-a2a5076f4cab from port ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a May 24 15:45:13.805173 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8bd66987-953b-4c13-806f-7f6feb5cd883 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "POST /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/action" status: 202 len: 0 microversion: 2.1 time: 0.591208 May 24 15:45:13.806022 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 427/805] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:45:13 2022] POST /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:45:13.832989 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-f2299ffb-066d-4b8f-8260-de093a7d6add req-bd1a4b44-3b7a-4150-af0f-d66abafff881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b926408-71dd-454e-b9d3-7d4e0d12e270", "tag": "ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:13.846779 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-f2299ffb-066d-4b8f-8260-de093a7d6add req-bd1a4b44-3b7a-4150-af0f-d66abafff881 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:13.849872 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-f2299ffb-066d-4b8f-8260-de093a7d6add req-bd1a4b44-3b7a-4150-af0f-d66abafff881 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:13.884669 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-f2299ffb-066d-4b8f-8260-de093a7d6add req-bd1a4b44-3b7a-4150-af0f-d66abafff881 service nova] Creating event network-changed:ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a for instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 on hv-cinder-84315 May 24 15:45:13.891849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-f2299ffb-066d-4b8f-8260-de093a7d6add req-bd1a4b44-3b7a-4150-af0f-d66abafff881 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062787 May 24 15:45:13.893415 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 379/806] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:45:15.058700 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d99a54d2-54d6-4caa-8ef8-08f611165b65 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:15.059218 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d99a54d2-54d6-4caa-8ef8-08f611165b65 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:15.065961 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d99a54d2-54d6-4caa-8ef8-08f611165b65 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:15.066404 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d99a54d2-54d6-4caa-8ef8-08f611165b65 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:15.067466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d99a54d2-54d6-4caa-8ef8-08f611165b65 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:15.068171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d99a54d2-54d6-4caa-8ef8-08f611165b65 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:15.160700 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-d99a54d2-54d6-4caa-8ef8-08f611165b65 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lazy-loading 'services' on Instance uuid 2b926408-71dd-454e-b9d3-7d4e0d12e270 {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:45:15.241500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d99a54d2-54d6-4caa-8ef8-08f611165b65 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments/3e38ed2a-33b7-43d2-982c-08dbd571e226" status: 202 len: 0 microversion: 2.1 time: 0.186661 May 24 15:45:15.242649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 428/807] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:45:15 2022] DELETE /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments/3e38ed2a-33b7-43d2-982c-08dbd571e226 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:45:15.252372 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-51c36d22-1478-4319-b272-aa9f31937783 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:15.261365 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-51c36d22-1478-4319-b272-aa9f31937783 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:15.274472 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-51c36d22-1478-4319-b272-aa9f31937783 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:15.274953 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-51c36d22-1478-4319-b272-aa9f31937783 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:15.275854 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-51c36d22-1478-4319-b272-aa9f31937783 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:15.276323 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-51c36d22-1478-4319-b272-aa9f31937783 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:15.316514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-51c36d22-1478-4319-b272-aa9f31937783 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068007 May 24 15:45:15.317379 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 380/808] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:45:15 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:45:15.914617 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-170d86ee-62d7-44bd-bea4-5e93f671f6b3 req-695ddd4f-68eb-4046-9f71-063019955fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b926408-71dd-454e-b9d3-7d4e0d12e270", "tag": "ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:15.923172 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-170d86ee-62d7-44bd-bea4-5e93f671f6b3 req-695ddd4f-68eb-4046-9f71-063019955fe7 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:15.923610 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-170d86ee-62d7-44bd-bea4-5e93f671f6b3 req-695ddd4f-68eb-4046-9f71-063019955fe7 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:15.934768 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-170d86ee-62d7-44bd-bea4-5e93f671f6b3 req-695ddd4f-68eb-4046-9f71-063019955fe7 service nova] Creating event network-changed:ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a for instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 on hv-cinder-84315 May 24 15:45:15.939838 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-170d86ee-62d7-44bd-bea4-5e93f671f6b3 req-695ddd4f-68eb-4046-9f71-063019955fe7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030738 May 24 15:45:15.940659 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 429/809] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:45:16.328541 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1d8db8e5-bb79-4c81-8c63-f66d977a4ebb tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:16.329479 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1d8db8e5-bb79-4c81-8c63-f66d977a4ebb tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:16.341537 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1d8db8e5-bb79-4c81-8c63-f66d977a4ebb tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:16.342002 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1d8db8e5-bb79-4c81-8c63-f66d977a4ebb tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:16.342795 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1d8db8e5-bb79-4c81-8c63-f66d977a4ebb tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:16.343227 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1d8db8e5-bb79-4c81-8c63-f66d977a4ebb tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:16.379735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1d8db8e5-bb79-4c81-8c63-f66d977a4ebb tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055018 May 24 15:45:16.386973 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 381/810] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:45:16 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:45:16.395578 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2b240f80-5a09-492c-bad1-768bbdcaa064 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:16.396217 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2b240f80-5a09-492c-bad1-768bbdcaa064 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:16.404694 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2b240f80-5a09-492c-bad1-768bbdcaa064 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:16.405438 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2b240f80-5a09-492c-bad1-768bbdcaa064 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:16.406525 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2b240f80-5a09-492c-bad1-768bbdcaa064 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:16.407249 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2b240f80-5a09-492c-bad1-768bbdcaa064 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:16.516759 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-2b240f80-5a09-492c-bad1-768bbdcaa064 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] HTTP exception thrown: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 is not attached to volume 3e38ed2a-33b7-43d2-982c-08dbd571e226 May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2b240f80-5a09-492c-bad1-768bbdcaa064 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Request method failure captured: May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: DELETE /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments/3e38ed2a-33b7-43d2-982c-08dbd571e226 HTTP/1.1 May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP0IOH0Zod9eQAgkggLb1f_xwqwrtmy4jX224OGShKzrUL9IZofLQeWYhudUPhG2yruCmoIRuGFMamEupzskDMc_0QFvzg644f2HtXm3xtEKYUK0I3ffLFSpzqT0Cn-ddk1TzgVcqjaoOqVpoGYYe2qPjaqVywHvsjgFmbyrietOoF0 May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: b05a5e216dd141dabe29dfc71abee8ee May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-TestMinimumBasicScenario-569049402 May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:45:16.528254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b05a5e216dd141dabe29dfc71abee8ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b05a5e216dd141dabe29dfc71abee8ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b05a5e216dd141dabe29dfc71abee8ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b05a5e216dd141dabe29dfc71abee8ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-TestMinimumBasicScenario-569049402 May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: b05a5e216dd141dabe29dfc71abee8ee May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-TestMinimumBasicScenario-569049402 May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-TestMinimumBasicScenario-569049402-project May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 423be519855441a6863badc453828bea May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-TestMinimumBasicScenario-569049402-project May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:45:16.529750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 is not attached to volume 3e38ed2a-33b7-43d2-982c-08dbd571e226 May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'server_id': '2b926408-71dd-454e-b9d3-7d4e0d12e270', 'id': '3e38ed2a-33b7-43d2-982c-08dbd571e226'} May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3e38ed2a-33b7-43d2-982c-08dbd571e226. May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:45:16.530528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 is not attached to volume 3e38ed2a-33b7-43d2-982c-08dbd571e226 May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 is not attached to volume 3e38ed2a-33b7-43d2-982c-08dbd571e226 May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:16.532412 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2b240f80-5a09-492c-bad1-768bbdcaa064 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Returning 404 to user: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 is not attached to volume 3e38ed2a-33b7-43d2-982c-08dbd571e226 {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:45:16.533973 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2b240f80-5a09-492c-bad1-768bbdcaa064 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments/3e38ed2a-33b7-43d2-982c-08dbd571e226" status: 404 len: 154 microversion: 2.1 time: 0.141119 May 24 15:45:16.533973 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 430/811] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:45:16 2022] DELETE /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270/os-volume_attachments/3e38ed2a-33b7-43d2-982c-08dbd571e226 => generated 154 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:45:17.756100 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-783eda8b-53c1-48f6-aac0-095b3944aeae tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:17.756691 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-783eda8b-53c1-48f6-aac0-095b3944aeae tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:17.763438 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-783eda8b-53c1-48f6-aac0-095b3944aeae tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:17.763893 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-783eda8b-53c1-48f6-aac0-095b3944aeae tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:17.765800 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-783eda8b-53c1-48f6-aac0-095b3944aeae tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:17.766218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-783eda8b-53c1-48f6-aac0-095b3944aeae tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:17.793407 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-783eda8b-53c1-48f6-aac0-095b3944aeae tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:45:17.882456 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-783eda8b-53c1-48f6-aac0-095b3944aeae tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 204 len: 0 microversion: 2.1 time: 0.129623 May 24 15:45:17.884369 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 382/812] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:45:17 2022] DELETE /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:45:17.893201 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f54bcb6c-0439-45a0-9126-932b747dbf81 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:17.894999 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f54bcb6c-0439-45a0-9126-932b747dbf81 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:17.904948 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f54bcb6c-0439-45a0-9126-932b747dbf81 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:17.905391 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f54bcb6c-0439-45a0-9126-932b747dbf81 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:17.906427 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f54bcb6c-0439-45a0-9126-932b747dbf81 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:17.907082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f54bcb6c-0439-45a0-9126-932b747dbf81 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:18.094030 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f54bcb6c-0439-45a0-9126-932b747dbf81 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:18.104189 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f54bcb6c-0439-45a0-9126-932b747dbf81 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1555 microversion: 2.1 time: 0.215400 May 24 15:45:18.104784 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 431/813] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:17 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:19.123448 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7800c96e-4bb0-4083-b597-5905f95bbffa tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:19.124217 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7800c96e-4bb0-4083-b597-5905f95bbffa tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:19.130850 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7800c96e-4bb0-4083-b597-5905f95bbffa tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:19.131301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7800c96e-4bb0-4083-b597-5905f95bbffa tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:19.132301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7800c96e-4bb0-4083-b597-5905f95bbffa tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:19.132741 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7800c96e-4bb0-4083-b597-5905f95bbffa tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:19.258973 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1cd5bd9c-f1fe-4736-b7f7-f7ba367748cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: .version_select at 0x7fb1d47d7b80>, body: {"keypair": {"name": "tempest-keypair-1633668384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPnagAr44UX7shLjjk5O0y0a8HZZwiWQFF5y0KNWuD1+dE8Yj5hnEev6sIjoTt//REVKlBbKiiyuQTmYGpRfW8Yyu6AtQj2Hi1MggDoFDwxDxOfgxWAnk7wMoJehVnRUA=="}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:19.263938 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7800c96e-4bb0-4083-b597-5905f95bbffa tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:19.272171 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7800c96e-4bb0-4083-b597-5905f95bbffa tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1555 microversion: 2.1 time: 0.153617 May 24 15:45:19.272669 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 383/814] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:19 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:19.276732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-1cd5bd9c-f1fe-4736-b7f7-f7ba367748cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for project a30edd891b96456fbba6409a815f5fd8. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:45:19.280828 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-1cd5bd9c-f1fe-4736-b7f7-f7ba367748cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for user 0f8105d1de0d45218576d74a2ba4abe4 and project a30edd891b96456fbba6409a815f5fd8. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:45:19.306625 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1cd5bd9c-f1fe-4736-b7f7-f7ba367748cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185620 May 24 15:45:19.307233 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 432/815] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 24 15:45:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:45:20.294825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-b91277ea-81a9-44b0-a10f-8e0be4b990d0 req-3108574a-ab58-48b6-998b-363a0d4f3a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b926408-71dd-454e-b9d3-7d4e0d12e270", "name": "network-vif-deleted", "tag": "ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:20.301234 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9f787f04-f567-40df-8fa6-71d671b9f8e4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:20.301957 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9f787f04-f567-40df-8fa6-71d671b9f8e4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:20.311872 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-b91277ea-81a9-44b0-a10f-8e0be4b990d0 req-3108574a-ab58-48b6-998b-363a0d4f3a4c service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:20.323951 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9f787f04-f567-40df-8fa6-71d671b9f8e4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:20.324734 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-b91277ea-81a9-44b0-a10f-8e0be4b990d0 req-3108574a-ab58-48b6-998b-363a0d4f3a4c service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:20.325609 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9f787f04-f567-40df-8fa6-71d671b9f8e4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:20.327158 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9f787f04-f567-40df-8fa6-71d671b9f8e4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:20.327801 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9f787f04-f567-40df-8fa6-71d671b9f8e4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:20.345429 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-b91277ea-81a9-44b0-a10f-8e0be4b990d0 req-3108574a-ab58-48b6-998b-363a0d4f3a4c service nova] Creating event network-vif-deleted:ccc9bb9f-f8c4-4abc-a3cb-8fd494f00b1a for instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 on hv-cinder-84315 May 24 15:45:20.353644 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-b91277ea-81a9-44b0-a10f-8e0be4b990d0 req-3108574a-ab58-48b6-998b-363a0d4f3a4c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062699 May 24 15:45:20.355408 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 433/816] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:45:20.443342 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-9f787f04-f567-40df-8fa6-71d671b9f8e4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423be519855441a6863badc453828bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05a5e216dd141dabe29dfc71abee8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:20.459175 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9f787f04-f567-40df-8fa6-71d671b9f8e4 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 200 len: 1344 microversion: 2.1 time: 0.173573 May 24 15:45:20.461474 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 384/817] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:20 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 1344 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:20.859779 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1945234745", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1eca94ca-2475-4c7a-b305-a2f26b6c82f9"}], "security_groups": [{"name": "tempest-securitygroup--23130459"}], "key_name": "tempest-keypair-1633668384", "user_data": "}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:20.967446 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] validate_networks() for [('1eca94ca-2475-4c7a-b305-a2f26b6c82f9', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:45:21.348728 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:45:21.349342 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:45:21.349594 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:45:21.349992 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:45:21.350395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:45:21.360061 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:21.360515 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:21.361294 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:21.361719 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:21.379075 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for project a30edd891b96456fbba6409a815f5fd8. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:45:21.383276 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for user 0f8105d1de0d45218576d74a2ba4abe4 and project a30edd891b96456fbba6409a815f5fd8. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:45:21.395222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:45:21.397649 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:45:21.445155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ec39964c-d7d1-43b9-b361-76a16d522cdd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.590991 May 24 15:45:21.446139 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 434/818] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:45:20 2022] POST /compute/v2.1/servers => generated 400 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 15:45:21.455873 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-121ce635-e3b7-4c08-870a-c381a59049e4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:21.456667 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-121ce635-e3b7-4c08-870a-c381a59049e4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:21.478594 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-75b2d7c0-5701-4211-9edc-aa4ab8480c89 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:21.479509 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-75b2d7c0-5701-4211-9edc-aa4ab8480c89 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] [instance: 2b926408-71dd-454e-b9d3-7d4e0d12e270] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:21.491033 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-75b2d7c0-5701-4211-9edc-aa4ab8480c89 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:21.491479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-75b2d7c0-5701-4211-9edc-aa4ab8480c89 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:21.493085 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-75b2d7c0-5701-4211-9edc-aa4ab8480c89 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:21.493085 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-75b2d7c0-5701-4211-9edc-aa4ab8480c89 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:21.520606 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-121ce635-e3b7-4c08-870a-c381a59049e4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:21.528249 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-121ce635-e3b7-4c08-870a-c381a59049e4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1242 microversion: 2.1 time: 0.076051 May 24 15:45:21.538857 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 385/819] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:21 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:21.675858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-75b2d7c0-5701-4211-9edc-aa4ab8480c89 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] HTTP exception thrown: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 could not be found. May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-75b2d7c0-5701-4211-9edc-aa4ab8480c89 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Request method failure captured: May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 HTTP/1.1 May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP0IOH0Zod9eQAgkggLb1f_xwqwrtmy4jX224OGShKzrUL9IZofLQeWYhudUPhG2yruCmoIRuGFMamEupzskDMc_0QFvzg644f2HtXm3xtEKYUK0I3ffLFSpzqT0Cn-ddk1TzgVcqjaoOqVpoGYYe2qPjaqVywHvsjgFmbyrietOoF0 May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: b05a5e216dd141dabe29dfc71abee8ee May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-TestMinimumBasicScenario-569049402 May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:45:21.677472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b05a5e216dd141dabe29dfc71abee8ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b05a5e216dd141dabe29dfc71abee8ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b05a5e216dd141dabe29dfc71abee8ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b05a5e216dd141dabe29dfc71abee8ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-TestMinimumBasicScenario-569049402 May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: b05a5e216dd141dabe29dfc71abee8ee May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-TestMinimumBasicScenario-569049402 May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-TestMinimumBasicScenario-569049402-project May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 423be519855441a6863badc453828bea May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-TestMinimumBasicScenario-569049402-project May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 could not be found. May 24 15:45:21.679138 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '2b926408-71dd-454e-b9d3-7d4e0d12e270'} May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 could not be found. May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:45:21.681972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 could not be found. May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 could not be found. May 24 15:45:21.683456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:45:21.684838 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-75b2d7c0-5701-4211-9edc-aa4ab8480c89 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Returning 404 to user: Instance 2b926408-71dd-454e-b9d3-7d4e0d12e270 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:45:21.684838 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-75b2d7c0-5701-4211-9edc-aa4ab8480c89 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270" status: 404 len: 111 microversion: 2.1 time: 0.205516 May 24 15:45:21.684838 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 435/820] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:21 2022] GET /compute/v2.1/servers/2b926408-71dd-454e-b9d3-7d4e0d12e270 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:45:21.688243 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e449323a-7149-4fda-a0b4-49e40fb7f283 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] Calling method '.version_select at 0x7fb1d52418b0>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:21.708287 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e449323a-7149-4fda-a0b4-49e40fb7f283 tempest-TestMinimumBasicScenario-569049402 tempest-TestMinimumBasicScenario-569049402-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1006083692" status: 202 len: 0 microversion: 2.1 time: 0.024107 May 24 15:45:21.709011 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 386/821] 10.222.0.55 () {58 vars in 1271 bytes} [Tue May 24 15:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1006083692 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:45:22.547305 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b6544977-7d16-48e3-afe9-1ceed5a1ae09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:22.548845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b6544977-7d16-48e3-afe9-1ceed5a1ae09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:22.559032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b6544977-7d16-48e3-afe9-1ceed5a1ae09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:22.559468 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b6544977-7d16-48e3-afe9-1ceed5a1ae09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:22.560256 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b6544977-7d16-48e3-afe9-1ceed5a1ae09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:22.560851 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b6544977-7d16-48e3-afe9-1ceed5a1ae09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:22.660617 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b6544977-7d16-48e3-afe9-1ceed5a1ae09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:22.672204 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b6544977-7d16-48e3-afe9-1ceed5a1ae09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1302 microversion: 2.1 time: 0.130419 May 24 15:45:22.681116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 436/822] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:22 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1302 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:23.689161 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6eb2d2ab-baaa-43aa-82fe-f94d4f55f52a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:23.691281 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6eb2d2ab-baaa-43aa-82fe-f94d4f55f52a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:23.705202 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6eb2d2ab-baaa-43aa-82fe-f94d4f55f52a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:23.705920 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6eb2d2ab-baaa-43aa-82fe-f94d4f55f52a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:23.707469 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6eb2d2ab-baaa-43aa-82fe-f94d4f55f52a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:23.707953 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6eb2d2ab-baaa-43aa-82fe-f94d4f55f52a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:23.989665 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6eb2d2ab-baaa-43aa-82fe-f94d4f55f52a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:24.000450 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6eb2d2ab-baaa-43aa-82fe-f94d4f55f52a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1366 microversion: 2.1 time: 0.314991 May 24 15:45:24.002415 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 387/823] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:23 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:24.433901 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-7103977c-ad01-4c16-a9ff-7806d806e134 req-44714e7e-d0aa-4068-80ca-181c8545ee4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d", "tag": "0b3aafd5-72f6-4c1b-860e-b16344f56933"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:24.451575 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-7103977c-ad01-4c16-a9ff-7806d806e134 req-44714e7e-d0aa-4068-80ca-181c8545ee4d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:24.452337 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-7103977c-ad01-4c16-a9ff-7806d806e134 req-44714e7e-d0aa-4068-80ca-181c8545ee4d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:24.472814 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-7103977c-ad01-4c16-a9ff-7806d806e134 req-44714e7e-d0aa-4068-80ca-181c8545ee4d service nova] Creating event network-changed:0b3aafd5-72f6-4c1b-860e-b16344f56933 for instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d on hv-cinder-84315 May 24 15:45:24.481860 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-7103977c-ad01-4c16-a9ff-7806d806e134 req-44714e7e-d0aa-4068-80ca-181c8545ee4d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051474 May 24 15:45:24.483326 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 437/824] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:45:25.017683 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ba5aca85-3e8d-48cc-b884-086f0c3f1bd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:25.018256 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ba5aca85-3e8d-48cc-b884-086f0c3f1bd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:25.027789 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ba5aca85-3e8d-48cc-b884-086f0c3f1bd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:25.028687 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ba5aca85-3e8d-48cc-b884-086f0c3f1bd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:25.029848 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ba5aca85-3e8d-48cc-b884-086f0c3f1bd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:25.030629 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ba5aca85-3e8d-48cc-b884-086f0c3f1bd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:25.269695 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ba5aca85-3e8d-48cc-b884-086f0c3f1bd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:25.280452 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ba5aca85-3e8d-48cc-b884-086f0c3f1bd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1366 microversion: 2.1 time: 0.267033 May 24 15:45:25.281393 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 388/825] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:25 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:26.299077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-bc81e73d-2631-465a-9a0d-c9f74973c578 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:26.299825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-bc81e73d-2631-465a-9a0d-c9f74973c578 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:26.308561 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc81e73d-2631-465a-9a0d-c9f74973c578 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:26.308679 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc81e73d-2631-465a-9a0d-c9f74973c578 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:26.309366 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc81e73d-2631-465a-9a0d-c9f74973c578 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:26.310635 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc81e73d-2631-465a-9a0d-c9f74973c578 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:26.314933 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:26.582691 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-bc81e73d-2631-465a-9a0d-c9f74973c578 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:26.592059 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-bc81e73d-2631-465a-9a0d-c9f74973c578 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1366 microversion: 2.1 time: 0.297848 May 24 15:45:26.592858 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 438/826] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:26 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:27.609893 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b28c72bc-bbb2-4e75-98b6-a0f2156685cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:27.610537 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b28c72bc-bbb2-4e75-98b6-a0f2156685cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:27.616751 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b28c72bc-bbb2-4e75-98b6-a0f2156685cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:27.617199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b28c72bc-bbb2-4e75-98b6-a0f2156685cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:27.617959 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b28c72bc-bbb2-4e75-98b6-a0f2156685cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:27.618393 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b28c72bc-bbb2-4e75-98b6-a0f2156685cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:28.096309 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b28c72bc-bbb2-4e75-98b6-a0f2156685cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:28.106752 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b28c72bc-bbb2-4e75-98b6-a0f2156685cb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1366 microversion: 2.1 time: 0.500990 May 24 15:45:28.107448 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 389/827] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:27 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:45:29.125243 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-de7db58a-1c9c-4d83-8194-e5e3f91c2aa3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:29.126524 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-de7db58a-1c9c-4d83-8194-e5e3f91c2aa3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:29.144142 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-de7db58a-1c9c-4d83-8194-e5e3f91c2aa3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:29.144943 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-de7db58a-1c9c-4d83-8194-e5e3f91c2aa3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:29.145719 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-de7db58a-1c9c-4d83-8194-e5e3f91c2aa3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:29.146468 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-de7db58a-1c9c-4d83-8194-e5e3f91c2aa3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:29.364325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-de7db58a-1c9c-4d83-8194-e5e3f91c2aa3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:29.371871 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-de7db58a-1c9c-4d83-8194-e5e3f91c2aa3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1366 microversion: 2.1 time: 0.251696 May 24 15:45:29.372492 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 439/828] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:29 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:30.390374 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-85ba984c-f61d-4ebc-a183-17e635042782 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:30.390865 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-85ba984c-f61d-4ebc-a183-17e635042782 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:30.400587 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-85ba984c-f61d-4ebc-a183-17e635042782 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:30.401610 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-85ba984c-f61d-4ebc-a183-17e635042782 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:30.405082 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-85ba984c-f61d-4ebc-a183-17e635042782 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:30.405669 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-85ba984c-f61d-4ebc-a183-17e635042782 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:30.554486 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-85ba984c-f61d-4ebc-a183-17e635042782 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:30.560854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-2114b601-eaa4-402b-afba-a2e52123019d req-0afe5f22-8c0b-499c-81cf-eafd4aeaaa82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d", "name": "network-vif-plugged", "status": "completed", "tag": "0b3aafd5-72f6-4c1b-860e-b16344f56933"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:30.563575 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-85ba984c-f61d-4ebc-a183-17e635042782 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1366 microversion: 2.1 time: 0.178553 May 24 15:45:30.564759 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 390/829] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:30 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:30.575068 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-2114b601-eaa4-402b-afba-a2e52123019d req-0afe5f22-8c0b-499c-81cf-eafd4aeaaa82 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:30.575867 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-2114b601-eaa4-402b-afba-a2e52123019d req-0afe5f22-8c0b-499c-81cf-eafd4aeaaa82 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:30.587663 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-2114b601-eaa4-402b-afba-a2e52123019d req-0afe5f22-8c0b-499c-81cf-eafd4aeaaa82 service nova] Creating event network-vif-plugged:0b3aafd5-72f6-4c1b-860e-b16344f56933 for instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d on hv-cinder-84315 May 24 15:45:30.593128 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-2114b601-eaa4-402b-afba-a2e52123019d req-0afe5f22-8c0b-499c-81cf-eafd4aeaaa82 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037247 May 24 15:45:30.593866 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 440/830] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:45:31.581337 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-71ba1778-ca0d-4cb2-87ed-e926d829e7fb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:31.581940 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-71ba1778-ca0d-4cb2-87ed-e926d829e7fb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:31.584125 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:31.590459 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-71ba1778-ca0d-4cb2-87ed-e926d829e7fb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:31.590907 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-71ba1778-ca0d-4cb2-87ed-e926d829e7fb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:31.591653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-71ba1778-ca0d-4cb2-87ed-e926d829e7fb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:31.592123 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-71ba1778-ca0d-4cb2-87ed-e926d829e7fb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:31.740721 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-71ba1778-ca0d-4cb2-87ed-e926d829e7fb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:31.748535 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-71ba1778-ca0d-4cb2-87ed-e926d829e7fb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1366 microversion: 2.1 time: 0.171431 May 24 15:45:31.749105 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 391/831] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:31 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:32.763064 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:32.764250 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=10 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:32.769936 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cf3aafc6-4171-4f44-a761-765e588eb6c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:32.770648 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-cf3aafc6-4171-4f44-a761-765e588eb6c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:32.777793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf3aafc6-4171-4f44-a761-765e588eb6c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:32.778234 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf3aafc6-4171-4f44-a761-765e588eb6c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:32.778986 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf3aafc6-4171-4f44-a761-765e588eb6c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:32.779413 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf3aafc6-4171-4f44-a761-765e588eb6c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:32.917266 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-cf3aafc6-4171-4f44-a761-765e588eb6c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:32.925264 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cf3aafc6-4171-4f44-a761-765e588eb6c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1555 microversion: 2.1 time: 0.162871 May 24 15:45:32.925829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 441/832] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:32 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:32.941658 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-09354ce0-489a-40c6-9d01-70c608366147 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:32.942202 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-09354ce0-489a-40c6-9d01-70c608366147 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:32.948765 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09354ce0-489a-40c6-9d01-70c608366147 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:32.949214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09354ce0-489a-40c6-9d01-70c608366147 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:32.949968 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09354ce0-489a-40c6-9d01-70c608366147 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:32.950403 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-09354ce0-489a-40c6-9d01-70c608366147 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:33.030896 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-09354ce0-489a-40c6-9d01-70c608366147 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093092 May 24 15:45:33.031495 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 392/833] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 24 15:45:32 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:45:33.967517 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-adeae5c8-7b41-44bb-be53-af9f482e1719 req-4bfdb9f0-c700-4331-beb6-def7606bbbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d", "tag": "0b3aafd5-72f6-4c1b-860e-b16344f56933"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:33.976183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-adeae5c8-7b41-44bb-be53-af9f482e1719 req-4bfdb9f0-c700-4331-beb6-def7606bbbd2 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:33.976621 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-adeae5c8-7b41-44bb-be53-af9f482e1719 req-4bfdb9f0-c700-4331-beb6-def7606bbbd2 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:33.989951 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-adeae5c8-7b41-44bb-be53-af9f482e1719 req-4bfdb9f0-c700-4331-beb6-def7606bbbd2 service nova] Creating event network-changed:0b3aafd5-72f6-4c1b-860e-b16344f56933 for instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d on hv-cinder-84315 May 24 15:45:33.994984 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-adeae5c8-7b41-44bb-be53-af9f482e1719 req-4bfdb9f0-c700-4331-beb6-def7606bbbd2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031084 May 24 15:45:33.995782 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 442/834] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:45:40.561550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-29acb053-917d-4ef5-839f-1bb88710168c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:40.562102 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-29acb053-917d-4ef5-839f-1bb88710168c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:40.564081 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:40.569719 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-29acb053-917d-4ef5-839f-1bb88710168c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:40.570199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-29acb053-917d-4ef5-839f-1bb88710168c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:40.571044 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-29acb053-917d-4ef5-839f-1bb88710168c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:40.571472 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-29acb053-917d-4ef5-839f-1bb88710168c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:40.576394 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:40.668356 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-29acb053-917d-4ef5-839f-1bb88710168c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lazy-loading 'services' on Instance uuid 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:45:40.751105 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-29acb053-917d-4ef5-839f-1bb88710168c tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "DELETE /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/os-volume_attachments/2f11cbb9-8be9-4bbb-a4b6-a525f6670c13" status: 202 len: 0 microversion: 2.1 time: 0.194277 May 24 15:45:40.751571 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 393/835] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:45:40 2022] DELETE /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/os-volume_attachments/2f11cbb9-8be9-4bbb-a4b6-a525f6670c13 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:45:41.876360 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-30029065-a707-48b6-9e7f-d0ca3b67f08e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:41.878846 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:45:41.884630 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-30029065-a707-48b6-9e7f-d0ca3b67f08e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:41.885076 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-30029065-a707-48b6-9e7f-d0ca3b67f08e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:41.908174 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-30029065-a707-48b6-9e7f-d0ca3b67f08e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Going to try to stop instance {{(pid=129340) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 24 15:45:41.962399 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-30029065-a707-48b6-9e7f-d0ca3b67f08e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/action" status: 202 len: 0 microversion: 2.1 time: 0.093041 May 24 15:45:41.963190 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 443/836] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:45:41 2022] POST /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:45:41.974123 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3cbeef70-22d1-4d3a-a95d-ee8dd3fd6c59 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:41.975473 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3cbeef70-22d1-4d3a-a95d-ee8dd3fd6c59 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:41.983974 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3cbeef70-22d1-4d3a-a95d-ee8dd3fd6c59 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:41.984436 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3cbeef70-22d1-4d3a-a95d-ee8dd3fd6c59 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:41.985204 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3cbeef70-22d1-4d3a-a95d-ee8dd3fd6c59 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:41.985616 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3cbeef70-22d1-4d3a-a95d-ee8dd3fd6c59 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:42.131897 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-3cbeef70-22d1-4d3a-a95d-ee8dd3fd6c59 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:42.140016 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3cbeef70-22d1-4d3a-a95d-ee8dd3fd6c59 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1677 microversion: 2.1 time: 0.171632 May 24 15:45:42.140599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 394/837] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:41 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:45:43.161365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f816b0e2-86e5-406a-8b11-a623c3a6cae5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:43.162081 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f816b0e2-86e5-406a-8b11-a623c3a6cae5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:43.169337 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f816b0e2-86e5-406a-8b11-a623c3a6cae5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:43.169781 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f816b0e2-86e5-406a-8b11-a623c3a6cae5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:43.170542 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f816b0e2-86e5-406a-8b11-a623c3a6cae5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:43.170973 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f816b0e2-86e5-406a-8b11-a623c3a6cae5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:43.316559 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f816b0e2-86e5-406a-8b11-a623c3a6cae5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:43.324707 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f816b0e2-86e5-406a-8b11-a623c3a6cae5 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1677 microversion: 2.1 time: 0.169282 May 24 15:45:43.325272 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 444/838] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:43 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:44.346521 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0e9a2052-4c2b-44ad-a1c8-6fb563ca8af1 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:44.347508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0e9a2052-4c2b-44ad-a1c8-6fb563ca8af1 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:44.358483 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0e9a2052-4c2b-44ad-a1c8-6fb563ca8af1 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:44.359206 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0e9a2052-4c2b-44ad-a1c8-6fb563ca8af1 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:44.360504 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0e9a2052-4c2b-44ad-a1c8-6fb563ca8af1 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:44.361217 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0e9a2052-4c2b-44ad-a1c8-6fb563ca8af1 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:44.501932 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0e9a2052-4c2b-44ad-a1c8-6fb563ca8af1 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:44.509749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0e9a2052-4c2b-44ad-a1c8-6fb563ca8af1 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1677 microversion: 2.1 time: 0.169736 May 24 15:45:44.510317 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 395/839] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:44 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:45.531700 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-23fb7e9a-f4cc-449a-af1c-7e4238071fa3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:45.532790 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-23fb7e9a-f4cc-449a-af1c-7e4238071fa3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:45.540061 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-23fb7e9a-f4cc-449a-af1c-7e4238071fa3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:45.540532 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-23fb7e9a-f4cc-449a-af1c-7e4238071fa3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:45.541394 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-23fb7e9a-f4cc-449a-af1c-7e4238071fa3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:45.541906 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-23fb7e9a-f4cc-449a-af1c-7e4238071fa3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:45.679373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-23fb7e9a-f4cc-449a-af1c-7e4238071fa3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:45.687287 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-23fb7e9a-f4cc-449a-af1c-7e4238071fa3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1677 microversion: 2.1 time: 0.162427 May 24 15:45:45.688086 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 445/840] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:45 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:46.708990 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-710f1645-2c7b-4835-80d9-f0b61b1e1b1f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:46.710044 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-710f1645-2c7b-4835-80d9-f0b61b1e1b1f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:46.717780 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-710f1645-2c7b-4835-80d9-f0b61b1e1b1f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:46.718219 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-710f1645-2c7b-4835-80d9-f0b61b1e1b1f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:46.718976 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-710f1645-2c7b-4835-80d9-f0b61b1e1b1f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:46.719411 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-710f1645-2c7b-4835-80d9-f0b61b1e1b1f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:46.857806 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-710f1645-2c7b-4835-80d9-f0b61b1e1b1f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:46.865587 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-710f1645-2c7b-4835-80d9-f0b61b1e1b1f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1677 microversion: 2.1 time: 0.163136 May 24 15:45:46.866149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 396/841] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:46 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:47.887306 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-834d1e26-8a54-41fb-815a-a2dd9e905709 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:47.888500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-834d1e26-8a54-41fb-815a-a2dd9e905709 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:47.897315 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-834d1e26-8a54-41fb-815a-a2dd9e905709 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:47.897755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-834d1e26-8a54-41fb-815a-a2dd9e905709 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:47.898511 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-834d1e26-8a54-41fb-815a-a2dd9e905709 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:47.898941 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-834d1e26-8a54-41fb-815a-a2dd9e905709 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:48.042136 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-834d1e26-8a54-41fb-815a-a2dd9e905709 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:48.050139 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-834d1e26-8a54-41fb-815a-a2dd9e905709 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1677 microversion: 2.1 time: 0.169459 May 24 15:45:48.050702 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 446/842] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:47 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:49.071252 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-192e19a4-e94a-4f0f-a44c-be4ccc8034dd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:49.072353 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-192e19a4-e94a-4f0f-a44c-be4ccc8034dd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:49.083631 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-192e19a4-e94a-4f0f-a44c-be4ccc8034dd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:49.084451 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-192e19a4-e94a-4f0f-a44c-be4ccc8034dd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:49.085707 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-192e19a4-e94a-4f0f-a44c-be4ccc8034dd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:49.086421 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-192e19a4-e94a-4f0f-a44c-be4ccc8034dd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:49.225977 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-192e19a4-e94a-4f0f-a44c-be4ccc8034dd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:49.237762 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-192e19a4-e94a-4f0f-a44c-be4ccc8034dd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1677 microversion: 2.1 time: 0.173386 May 24 15:45:49.238577 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 397/843] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:49 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:50.258933 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-13f48fa1-1be0-4e7f-829f-d657ec2eb190 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:50.259935 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-13f48fa1-1be0-4e7f-829f-d657ec2eb190 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:50.270125 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-13f48fa1-1be0-4e7f-829f-d657ec2eb190 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:50.270572 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-13f48fa1-1be0-4e7f-829f-d657ec2eb190 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:50.271331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-13f48fa1-1be0-4e7f-829f-d657ec2eb190 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:50.271764 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-13f48fa1-1be0-4e7f-829f-d657ec2eb190 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:50.413973 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-13f48fa1-1be0-4e7f-829f-d657ec2eb190 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:50.421641 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-13f48fa1-1be0-4e7f-829f-d657ec2eb190 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1677 microversion: 2.1 time: 0.169518 May 24 15:45:50.422192 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 447/844] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:50 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:51.444233 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ddf16f04-3834-41d8-b45a-5fc5016160de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:51.445201 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ddf16f04-3834-41d8-b45a-5fc5016160de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:51.457439 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ddf16f04-3834-41d8-b45a-5fc5016160de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:51.458185 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ddf16f04-3834-41d8-b45a-5fc5016160de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:51.459461 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ddf16f04-3834-41d8-b45a-5fc5016160de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:51.460200 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ddf16f04-3834-41d8-b45a-5fc5016160de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:51.593896 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-ddf16f04-3834-41d8-b45a-5fc5016160de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:51.601692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ddf16f04-3834-41d8-b45a-5fc5016160de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1677 microversion: 2.1 time: 0.164724 May 24 15:45:51.602232 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 398/845] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:51 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:52.623535 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-303ef46c-43fe-428f-b086-d7b603a6fa77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:52.624472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-303ef46c-43fe-428f-b086-d7b603a6fa77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:52.636141 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-303ef46c-43fe-428f-b086-d7b603a6fa77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:52.636926 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-303ef46c-43fe-428f-b086-d7b603a6fa77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:52.638734 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-303ef46c-43fe-428f-b086-d7b603a6fa77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:52.639423 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-303ef46c-43fe-428f-b086-d7b603a6fa77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:52.785171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-303ef46c-43fe-428f-b086-d7b603a6fa77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:52.793025 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-303ef46c-43fe-428f-b086-d7b603a6fa77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1654 microversion: 2.1 time: 0.176701 May 24 15:45:52.793594 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 448/846] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:52 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1654 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:52.816973 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2d579b2c-3515-41d7-987f-85525bdfc270 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:45:52.824218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2d579b2c-3515-41d7-987f-85525bdfc270 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:52.824669 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2d579b2c-3515-41d7-987f-85525bdfc270 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:52.848363 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2d579b2c-3515-41d7-987f-85525bdfc270 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Going to try to start instance {{(pid=129339) start /opt/stack/nova/nova/compute/api.py:2730}} May 24 15:45:52.895880 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2d579b2c-3515-41d7-987f-85525bdfc270 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/action" status: 202 len: 0 microversion: 2.1 time: 0.083789 May 24 15:45:52.896548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 399/847] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:45:52 2022] POST /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:45:52.907154 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-261c15f7-bb99-485d-a727-da370ad991b8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:52.907948 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-261c15f7-bb99-485d-a727-da370ad991b8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:52.914434 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-261c15f7-bb99-485d-a727-da370ad991b8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:52.914882 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-261c15f7-bb99-485d-a727-da370ad991b8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:52.915653 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-261c15f7-bb99-485d-a727-da370ad991b8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:52.916091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-261c15f7-bb99-485d-a727-da370ad991b8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:53.047766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-261c15f7-bb99-485d-a727-da370ad991b8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:53.055719 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-261c15f7-bb99-485d-a727-da370ad991b8 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1663 microversion: 2.1 time: 0.154340 May 24 15:45:53.056319 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 449/848] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:52 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:45:54.075434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a3883efe-7893-47d1-8277-a67fa3c64cff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:54.076284 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a3883efe-7893-47d1-8277-a67fa3c64cff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:54.083905 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a3883efe-7893-47d1-8277-a67fa3c64cff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:54.084373 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a3883efe-7893-47d1-8277-a67fa3c64cff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:54.085124 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a3883efe-7893-47d1-8277-a67fa3c64cff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:54.085554 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a3883efe-7893-47d1-8277-a67fa3c64cff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:54.224940 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a3883efe-7893-47d1-8277-a67fa3c64cff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:54.237200 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a3883efe-7893-47d1-8277-a67fa3c64cff tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1663 microversion: 2.1 time: 0.165744 May 24 15:45:54.237933 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 400/849] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:54 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:45:55.257957 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-56567153-fd21-421b-842e-a4eae1b1981f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:45:55.258565 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-56567153-fd21-421b-842e-a4eae1b1981f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:45:55.265823 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-56567153-fd21-421b-842e-a4eae1b1981f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:55.266297 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-56567153-fd21-421b-842e-a4eae1b1981f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:55.267061 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-56567153-fd21-421b-842e-a4eae1b1981f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:45:55.267693 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-56567153-fd21-421b-842e-a4eae1b1981f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:45:55.411438 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-56567153-fd21-421b-842e-a4eae1b1981f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:45:55.419123 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-56567153-fd21-421b-842e-a4eae1b1981f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1667 microversion: 2.1 time: 0.165130 May 24 15:45:55.419691 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 450/850] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:45:55 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:09.961535 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-459ce036-e97c-4fa1-a290-254e2cd7bcbb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:09.962071 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-459ce036-e97c-4fa1-a290-254e2cd7bcbb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:09.964330 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=15 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:09.964967 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:09.972092 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-459ce036-e97c-4fa1-a290-254e2cd7bcbb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:09.972538 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-459ce036-e97c-4fa1-a290-254e2cd7bcbb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:09.973352 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-459ce036-e97c-4fa1-a290-254e2cd7bcbb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:09.973781 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-459ce036-e97c-4fa1-a290-254e2cd7bcbb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:09.998026 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-459ce036-e97c-4fa1-a290-254e2cd7bcbb tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/ips" status: 200 len: 148 microversion: 2.1 time: 0.040368 May 24 15:46:09.998592 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 401/851] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 24 15:46:09 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:11.353004 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-1a2df596-1c4d-439e-8cf6-d31198f2edd0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e62d900-390c-4f06-9fb4-afe738a104f6"}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:11.354053 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-1a2df596-1c4d-439e-8cf6-d31198f2edd0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:11.356215 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=15 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:11.356827 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:11.362672 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1a2df596-1c4d-439e-8cf6-d31198f2edd0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:11.363117 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1a2df596-1c4d-439e-8cf6-d31198f2edd0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:11.363913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1a2df596-1c4d-439e-8cf6-d31198f2edd0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:11.364363 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-1a2df596-1c4d-439e-8cf6-d31198f2edd0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:11.643416 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-1a2df596-1c4d-439e-8cf6-d31198f2edd0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294359 May 24 15:46:11.644050 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 451/852] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:46:11 2022] POST /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:46:19.202535 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-03550855-1b6d-4ae8-a31f-74b6c8571dc5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: .version_select at 0x7fb1d51eaaf0>, body: {"keypair": {"name": "tempest-keypair-1401170325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRbpRoDP+B+g1E7Mm5dGdn4nuuCBW0moxtQptTd5h4Kymxgny/e7l8AS2Va/WaXGK1+oUF+LRthG1GV1PAa19xUdBsJHWFPieMh3Gn0sxnMikjF3LXmZLUcx8znRJIGWA=="}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:19.217842 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-03550855-1b6d-4ae8-a31f-74b6c8571dc5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for project a30edd891b96456fbba6409a815f5fd8. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:46:19.222129 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-03550855-1b6d-4ae8-a31f-74b6c8571dc5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for user 0f8105d1de0d45218576d74a2ba4abe4 and project a30edd891b96456fbba6409a815f5fd8. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:46:19.248392 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-03550855-1b6d-4ae8-a31f-74b6c8571dc5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049613 May 24 15:46:19.248985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 402/853] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 24 15:46:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:20.621164 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-685679896", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1eca94ca-2475-4c7a-b305-a2f26b6c82f9"}], "security_groups": [{"name": "tempest-securitygroup--1346173367"}], "key_name": "tempest-keypair-1401170325", "user_data": "}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:20.732867 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] validate_networks() for [('1eca94ca-2475-4c7a-b305-a2f26b6c82f9', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:46:21.122307 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:46:21.122703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:46:21.123135 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:46:21.123555 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:46:21.123954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:46:21.133228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:21.133661 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:21.134437 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:21.134857 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:21.152313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for project a30edd891b96456fbba6409a815f5fd8. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:46:21.156425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for user 0f8105d1de0d45218576d74a2ba4abe4 and project a30edd891b96456fbba6409a815f5fd8. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:46:21.167856 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:46:21.170216 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:46:21.220388 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f999172a-4691-4c1a-b32c-63e8e2bd38a5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606753 May 24 15:46:21.221223 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 452/854] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:46:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:46:21.228169 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=4 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:21.232813 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-59a50119-61b6-4a6e-9653-822a6b65081f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:21.233426 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-59a50119-61b6-4a6e-9653-822a6b65081f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:21.292389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-59a50119-61b6-4a6e-9653-822a6b65081f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:21.299555 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-59a50119-61b6-4a6e-9653-822a6b65081f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1241 microversion: 2.1 time: 0.072195 May 24 15:46:21.300174 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 403/855] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:21 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:22.317421 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-46fa0337-c392-43d6-8edf-e755aa57d172 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:22.318021 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-46fa0337-c392-43d6-8edf-e755aa57d172 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:22.325040 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-46fa0337-c392-43d6-8edf-e755aa57d172 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:22.325479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-46fa0337-c392-43d6-8edf-e755aa57d172 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:22.326231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-46fa0337-c392-43d6-8edf-e755aa57d172 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:22.326656 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-46fa0337-c392-43d6-8edf-e755aa57d172 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:22.661879 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-46fa0337-c392-43d6-8edf-e755aa57d172 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:22.669520 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-46fa0337-c392-43d6-8edf-e755aa57d172 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1245 microversion: 2.1 time: 0.356573 May 24 15:46:22.670091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 453/856] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:22 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1245 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:23.686933 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e5443339-9b03-4f77-ad86-915790571913 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:23.687491 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e5443339-9b03-4f77-ad86-915790571913 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:23.694335 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e5443339-9b03-4f77-ad86-915790571913 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:23.694812 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e5443339-9b03-4f77-ad86-915790571913 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:23.695553 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e5443339-9b03-4f77-ad86-915790571913 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:23.695982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e5443339-9b03-4f77-ad86-915790571913 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:23.758395 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e5443339-9b03-4f77-ad86-915790571913 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:23.766177 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e5443339-9b03-4f77-ad86-915790571913 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1299 microversion: 2.1 time: 0.083288 May 24 15:46:23.766784 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 404/857] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:23 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:24.783205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-50d0931a-57ea-49d9-ac78-9e56569c37c5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:24.783783 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-50d0931a-57ea-49d9-ac78-9e56569c37c5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:24.790859 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-50d0931a-57ea-49d9-ac78-9e56569c37c5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:24.791482 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-50d0931a-57ea-49d9-ac78-9e56569c37c5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:24.792390 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-50d0931a-57ea-49d9-ac78-9e56569c37c5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:24.792882 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-50d0931a-57ea-49d9-ac78-9e56569c37c5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:24.936928 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-50d0931a-57ea-49d9-ac78-9e56569c37c5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:24.946277 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-50d0931a-57ea-49d9-ac78-9e56569c37c5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1367 microversion: 2.1 time: 0.166295 May 24 15:46:24.956635 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 454/858] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:24 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:25.082943 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-d86603f3-89c0-491c-9ba2-6f198cf9893e req-0e3fe07b-bfe7-4664-9dc0-754002ad3bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efdad178-71c5-4ee8-ae88-eb20542da928", "tag": "f3394494-955a-46e9-83d3-82a4d8a8342f"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:25.096747 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-d86603f3-89c0-491c-9ba2-6f198cf9893e req-0e3fe07b-bfe7-4664-9dc0-754002ad3bb2 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:25.097221 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-d86603f3-89c0-491c-9ba2-6f198cf9893e req-0e3fe07b-bfe7-4664-9dc0-754002ad3bb2 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:25.108729 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-d86603f3-89c0-491c-9ba2-6f198cf9893e req-0e3fe07b-bfe7-4664-9dc0-754002ad3bb2 service nova] Creating event network-changed:f3394494-955a-46e9-83d3-82a4d8a8342f for instance efdad178-71c5-4ee8-ae88-eb20542da928 on hv-cinder-84315 May 24 15:46:25.113918 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-d86603f3-89c0-491c-9ba2-6f198cf9893e req-0e3fe07b-bfe7-4664-9dc0-754002ad3bb2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036686 May 24 15:46:25.114548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 405/859] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:25.964971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c6e4b815-7dc0-48d7-a95d-3fb7ce9ff98d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:25.965667 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c6e4b815-7dc0-48d7-a95d-3fb7ce9ff98d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:25.973435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c6e4b815-7dc0-48d7-a95d-3fb7ce9ff98d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:25.973882 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c6e4b815-7dc0-48d7-a95d-3fb7ce9ff98d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:25.974628 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c6e4b815-7dc0-48d7-a95d-3fb7ce9ff98d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:25.975052 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c6e4b815-7dc0-48d7-a95d-3fb7ce9ff98d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:26.112630 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c6e4b815-7dc0-48d7-a95d-3fb7ce9ff98d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:26.120783 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c6e4b815-7dc0-48d7-a95d-3fb7ce9ff98d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1367 microversion: 2.1 time: 0.160748 May 24 15:46:26.121316 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 455/860] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:25 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:26.376936 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-633176418", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-466910550", "security_groups": [{"name": "tempest-secgroup-smoke-1280392271"}], "block_device_mapping_v2": [{"uuid": "1fe28dbd-454e-465b-9fb8-5629d7784899", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba8b5a97-3a6a-415b-bd0c-40ca3fe3e6b1"}]}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:26.516009 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] validate_networks() for [('ba8b5a97-3a6a-415b-bd0c-40ca3fe3e6b1', None, None, None, None, None)] {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:46:26.893407 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:46:26.893822 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:46:26.894287 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:46:26.894685 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:46:26.895090 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:46:26.904235 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:26.904682 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:26.905478 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:26.905911 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:26.922656 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Getting quotas for project dc2810000275432fb1337151b6883e90. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:46:26.927029 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Getting quotas for user 0a3a64d88e89402b907789c7f030e080 and project dc2810000275432fb1337151b6883e90. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:46:26.985886 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:46:26.989423 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fe28dbd-454e-465b-9fb8-5629d7784899',volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:46:27.124012 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-294e9611-6447-4ee2-8015-d2247e2eddae tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754034 May 24 15:46:27.124972 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 406/861] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:46:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:46:27.137949 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-5981b97a-619a-4431-ac98-309fbbbff759 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:27.138544 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-76bc351f-02b1-48b0-8637-2ac985f1af1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:27.138887 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-5981b97a-619a-4431-ac98-309fbbbff759 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:27.139296 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-76bc351f-02b1-48b0-8637-2ac985f1af1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:27.145884 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5981b97a-619a-4431-ac98-309fbbbff759 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:27.146370 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5981b97a-619a-4431-ac98-309fbbbff759 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:27.147161 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5981b97a-619a-4431-ac98-309fbbbff759 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:27.147852 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5981b97a-619a-4431-ac98-309fbbbff759 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:27.206486 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-76bc351f-02b1-48b0-8637-2ac985f1af1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:27.213220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-76bc351f-02b1-48b0-8637-2ac985f1af1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1093 microversion: 2.1 time: 0.078813 May 24 15:46:27.213934 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 407/862] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:27 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:46:27.297984 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-5981b97a-619a-4431-ac98-309fbbbff759 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:27.305597 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-5981b97a-619a-4431-ac98-309fbbbff759 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1367 microversion: 2.1 time: 0.172017 May 24 15:46:27.306154 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 456/863] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:27 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:28.230730 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-be03123b-189c-4846-8aa4-af8a34088395 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:28.231338 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-be03123b-189c-4846-8aa4-af8a34088395 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:28.238584 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-be03123b-189c-4846-8aa4-af8a34088395 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:28.239037 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-be03123b-189c-4846-8aa4-af8a34088395 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:28.240239 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-be03123b-189c-4846-8aa4-af8a34088395 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:28.240239 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-be03123b-189c-4846-8aa4-af8a34088395 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:28.307827 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-be03123b-189c-4846-8aa4-af8a34088395 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:28.315490 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-be03123b-189c-4846-8aa4-af8a34088395 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1209 microversion: 2.1 time: 0.088633 May 24 15:46:28.316059 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 408/864] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:28 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:28.322432 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-66c9a136-e5f8-46e4-9096-70ef43636a08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:28.323611 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-66c9a136-e5f8-46e4-9096-70ef43636a08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:28.330580 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-66c9a136-e5f8-46e4-9096-70ef43636a08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:28.331016 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-66c9a136-e5f8-46e4-9096-70ef43636a08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:28.331795 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-66c9a136-e5f8-46e4-9096-70ef43636a08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:28.332255 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-66c9a136-e5f8-46e4-9096-70ef43636a08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:28.464059 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-66c9a136-e5f8-46e4-9096-70ef43636a08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:28.472504 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-66c9a136-e5f8-46e4-9096-70ef43636a08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1367 microversion: 2.1 time: 0.153879 May 24 15:46:28.473179 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 457/865] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:28 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:46:29.333376 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a2452636-6c7f-4305-9db3-c0519371a9b4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:29.333976 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a2452636-6c7f-4305-9db3-c0519371a9b4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:29.341982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a2452636-6c7f-4305-9db3-c0519371a9b4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:29.342569 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a2452636-6c7f-4305-9db3-c0519371a9b4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:29.343339 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a2452636-6c7f-4305-9db3-c0519371a9b4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:29.343772 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a2452636-6c7f-4305-9db3-c0519371a9b4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:29.491354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-91e05c4e-c6b4-4179-832f-c4d95a138690 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:29.492913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-91e05c4e-c6b4-4179-832f-c4d95a138690 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:29.499560 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a2452636-6c7f-4305-9db3-c0519371a9b4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:29.504921 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-91e05c4e-c6b4-4179-832f-c4d95a138690 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:29.505556 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-91e05c4e-c6b4-4179-832f-c4d95a138690 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:29.506770 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-91e05c4e-c6b4-4179-832f-c4d95a138690 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:29.507521 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-91e05c4e-c6b4-4179-832f-c4d95a138690 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:29.509434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a2452636-6c7f-4305-9db3-c0519371a9b4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.180347 May 24 15:46:29.510694 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 409/866] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:29 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:29.651091 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-91e05c4e-c6b4-4179-832f-c4d95a138690 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:29.659832 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-91e05c4e-c6b4-4179-832f-c4d95a138690 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1367 microversion: 2.1 time: 0.174009 May 24 15:46:29.664112 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 458/867] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:29 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:46:29.671890 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-13406a57-eacb-4208-b472-8fe062d95f62 req-15768b9a-23c5-4196-bd4e-18bf434a4a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f052d1b5-52db-4a7f-9455-19439d077d63", "tag": "32c2c21f-098c-426f-a69f-e6795e6db5ba"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:29.684661 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-13406a57-eacb-4208-b472-8fe062d95f62 req-15768b9a-23c5-4196-bd4e-18bf434a4a76 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:29.685137 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-13406a57-eacb-4208-b472-8fe062d95f62 req-15768b9a-23c5-4196-bd4e-18bf434a4a76 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:29.712832 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-13406a57-eacb-4208-b472-8fe062d95f62 req-15768b9a-23c5-4196-bd4e-18bf434a4a76 service nova] Creating event network-changed:32c2c21f-098c-426f-a69f-e6795e6db5ba for instance f052d1b5-52db-4a7f-9455-19439d077d63 on hv-cinder-84315 May 24 15:46:29.719109 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-13406a57-eacb-4208-b472-8fe062d95f62 req-15768b9a-23c5-4196-bd4e-18bf434a4a76 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055860 May 24 15:46:29.720052 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 410/868] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:30.527166 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d0e745b3-971f-4b2d-b744-14a87aacd13d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:30.527782 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d0e745b3-971f-4b2d-b744-14a87aacd13d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:30.535254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0e745b3-971f-4b2d-b744-14a87aacd13d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:30.535741 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0e745b3-971f-4b2d-b744-14a87aacd13d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:30.536581 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0e745b3-971f-4b2d-b744-14a87aacd13d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:30.537040 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0e745b3-971f-4b2d-b744-14a87aacd13d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:30.678435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d0e745b3-971f-4b2d-b744-14a87aacd13d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:30.678627 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f9b69fe4-9699-4504-8513-554c11248778 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:30.679266 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f9b69fe4-9699-4504-8513-554c11248778 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:30.686244 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f9b69fe4-9699-4504-8513-554c11248778 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:30.686690 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f9b69fe4-9699-4504-8513-554c11248778 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:30.687461 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f9b69fe4-9699-4504-8513-554c11248778 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:30.690120 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f9b69fe4-9699-4504-8513-554c11248778 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:30.691019 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d0e745b3-971f-4b2d-b744-14a87aacd13d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.167716 May 24 15:46:30.691701 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 459/869] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:30 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:30.833765 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f9b69fe4-9699-4504-8513-554c11248778 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:30.841926 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f9b69fe4-9699-4504-8513-554c11248778 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1367 microversion: 2.1 time: 0.168550 May 24 15:46:30.842691 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 411/870] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:30 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:30.937057 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-21f6abb8-2b94-42f7-9f83-b01ecf0fcde7 req-51bef689-426b-4e11-ba82-835023f3c0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdad178-71c5-4ee8-ae88-eb20542da928", "name": "network-vif-plugged", "status": "completed", "tag": "f3394494-955a-46e9-83d3-82a4d8a8342f"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:30.946079 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-21f6abb8-2b94-42f7-9f83-b01ecf0fcde7 req-51bef689-426b-4e11-ba82-835023f3c0cb service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:30.946519 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-21f6abb8-2b94-42f7-9f83-b01ecf0fcde7 req-51bef689-426b-4e11-ba82-835023f3c0cb service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:30.959562 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-21f6abb8-2b94-42f7-9f83-b01ecf0fcde7 req-51bef689-426b-4e11-ba82-835023f3c0cb service nova] Creating event network-vif-plugged:f3394494-955a-46e9-83d3-82a4d8a8342f for instance efdad178-71c5-4ee8-ae88-eb20542da928 on hv-cinder-84315 May 24 15:46:30.964775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-21f6abb8-2b94-42f7-9f83-b01ecf0fcde7 req-51bef689-426b-4e11-ba82-835023f3c0cb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031469 May 24 15:46:30.965365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 460/871] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:31.122366 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-8d81ec22-27ec-44f1-b245-ee05409fd627 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:31.123285 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-8d81ec22-27ec-44f1-b245-ee05409fd627 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:31.129810 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8d81ec22-27ec-44f1-b245-ee05409fd627 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.130253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8d81ec22-27ec-44f1-b245-ee05409fd627 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.131008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8d81ec22-27ec-44f1-b245-ee05409fd627 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.131434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-8d81ec22-27ec-44f1-b245-ee05409fd627 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.161129 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-8d81ec22-27ec-44f1-b245-ee05409fd627 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042812 May 24 15:46:31.161735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 412/872] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:46:31 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:46:31.219074 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:31.219965 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=6 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:31.224557 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-922c58ad-7ae8-4285-b399-abe8db23f52b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:31.225428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-922c58ad-7ae8-4285-b399-abe8db23f52b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:31.232466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-922c58ad-7ae8-4285-b399-abe8db23f52b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.232906 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-922c58ad-7ae8-4285-b399-abe8db23f52b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.233660 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-922c58ad-7ae8-4285-b399-abe8db23f52b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.234085 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-922c58ad-7ae8-4285-b399-abe8db23f52b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.258958 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-922c58ad-7ae8-4285-b399-abe8db23f52b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Going to try to terminate instance {{(pid=129340) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:46:31.351779 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-922c58ad-7ae8-4285-b399-abe8db23f52b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "DELETE /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 204 len: 0 microversion: 2.1 time: 0.133273 May 24 15:46:31.352450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 461/873] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:46:31 2022] DELETE /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:46:31.360823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e073d98b-a415-4518-ac20-79712fc36c88 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:31.361432 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e073d98b-a415-4518-ac20-79712fc36c88 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:31.367819 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e073d98b-a415-4518-ac20-79712fc36c88 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.368322 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e073d98b-a415-4518-ac20-79712fc36c88 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.369082 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e073d98b-a415-4518-ac20-79712fc36c88 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.369517 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e073d98b-a415-4518-ac20-79712fc36c88 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.504479 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e073d98b-a415-4518-ac20-79712fc36c88 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:31.515978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e073d98b-a415-4518-ac20-79712fc36c88 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1673 microversion: 2.1 time: 0.158843 May 24 15:46:31.516732 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 413/874] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:31 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:31.709134 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-be15785c-d8a8-4868-aea3-72ef3cd0cf85 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:31.709835 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-be15785c-d8a8-4868-aea3-72ef3cd0cf85 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:31.716803 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-be15785c-d8a8-4868-aea3-72ef3cd0cf85 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.717220 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-be15785c-d8a8-4868-aea3-72ef3cd0cf85 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.718257 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-be15785c-d8a8-4868-aea3-72ef3cd0cf85 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.718394 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-be15785c-d8a8-4868-aea3-72ef3cd0cf85 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.851144 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-be15785c-d8a8-4868-aea3-72ef3cd0cf85 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:31.858754 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-971f5dc5-012b-4987-b65f-ec399e7dfc51 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:31.859285 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-be15785c-d8a8-4868-aea3-72ef3cd0cf85 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.154079 May 24 15:46:31.859404 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-971f5dc5-012b-4987-b65f-ec399e7dfc51 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:31.859506 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 462/875] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:31 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:31.866332 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-971f5dc5-012b-4987-b65f-ec399e7dfc51 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.866815 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-971f5dc5-012b-4987-b65f-ec399e7dfc51 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:31.867584 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-971f5dc5-012b-4987-b65f-ec399e7dfc51 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:31.868014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-971f5dc5-012b-4987-b65f-ec399e7dfc51 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:32.004470 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-971f5dc5-012b-4987-b65f-ec399e7dfc51 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:32.011970 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-971f5dc5-012b-4987-b65f-ec399e7dfc51 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1367 microversion: 2.1 time: 0.157063 May 24 15:46:32.012876 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 414/876] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:31 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:32.535951 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3c0240d3-6734-472c-afb3-5880c9bf12be tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:32.536546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3c0240d3-6734-472c-afb3-5880c9bf12be tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:32.542988 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3c0240d3-6734-472c-afb3-5880c9bf12be tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:32.543500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3c0240d3-6734-472c-afb3-5880c9bf12be tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:32.544210 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3c0240d3-6734-472c-afb3-5880c9bf12be tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:32.544711 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3c0240d3-6734-472c-afb3-5880c9bf12be tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:32.701183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3c0240d3-6734-472c-afb3-5880c9bf12be tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:32.709053 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3c0240d3-6734-472c-afb3-5880c9bf12be tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1673 microversion: 2.1 time: 0.177731 May 24 15:46:32.709613 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 463/877] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:32 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:32.880515 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7757898f-c224-4ade-9235-7c6fd5c507e1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:32.881548 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7757898f-c224-4ade-9235-7c6fd5c507e1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:32.892695 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7757898f-c224-4ade-9235-7c6fd5c507e1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:32.893407 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7757898f-c224-4ade-9235-7c6fd5c507e1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:32.894600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7757898f-c224-4ade-9235-7c6fd5c507e1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:32.895397 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7757898f-c224-4ade-9235-7c6fd5c507e1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:33.029434 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f39ce166-b1b1-4fc5-9130-0e50502070cc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:33.030139 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-f39ce166-b1b1-4fc5-9130-0e50502070cc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:33.037084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f39ce166-b1b1-4fc5-9130-0e50502070cc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:33.037603 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f39ce166-b1b1-4fc5-9130-0e50502070cc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:33.038367 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f39ce166-b1b1-4fc5-9130-0e50502070cc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:33.038824 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-f39ce166-b1b1-4fc5-9130-0e50502070cc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:33.047799 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7757898f-c224-4ade-9235-7c6fd5c507e1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:33.055681 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7757898f-c224-4ade-9235-7c6fd5c507e1 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.181882 May 24 15:46:33.056272 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 415/878] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:32 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:33.175132 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-f39ce166-b1b1-4fc5-9130-0e50502070cc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:33.185348 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f39ce166-b1b1-4fc5-9130-0e50502070cc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1367 microversion: 2.1 time: 0.159753 May 24 15:46:33.185909 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 464/879] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:33 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:46:33.730215 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-42a44e13-b3c2-49e7-81ca-89072941df27 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:33.730773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-42a44e13-b3c2-49e7-81ca-89072941df27 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:33.737946 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-42a44e13-b3c2-49e7-81ca-89072941df27 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:33.738388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-42a44e13-b3c2-49e7-81ca-89072941df27 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:33.739150 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-42a44e13-b3c2-49e7-81ca-89072941df27 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:33.739589 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-42a44e13-b3c2-49e7-81ca-89072941df27 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:33.882276 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-42a44e13-b3c2-49e7-81ca-89072941df27 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:33.890464 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-42a44e13-b3c2-49e7-81ca-89072941df27 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1673 microversion: 2.1 time: 0.164588 May 24 15:46:33.891029 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 416/880] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:33 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:34.075146 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-643bcca3-6391-4247-a45c-039ae66be783 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:34.076077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-643bcca3-6391-4247-a45c-039ae66be783 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:34.085564 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-643bcca3-6391-4247-a45c-039ae66be783 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:34.086164 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-643bcca3-6391-4247-a45c-039ae66be783 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:34.087236 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-643bcca3-6391-4247-a45c-039ae66be783 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:34.087888 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-643bcca3-6391-4247-a45c-039ae66be783 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:34.202540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-dd36ab9d-eb18-4d5c-b7db-5ca397dcc7d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:34.203140 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-dd36ab9d-eb18-4d5c-b7db-5ca397dcc7d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:34.209710 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd36ab9d-eb18-4d5c-b7db-5ca397dcc7d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:34.210153 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd36ab9d-eb18-4d5c-b7db-5ca397dcc7d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:34.210916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd36ab9d-eb18-4d5c-b7db-5ca397dcc7d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:34.211355 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-dd36ab9d-eb18-4d5c-b7db-5ca397dcc7d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:34.226697 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-643bcca3-6391-4247-a45c-039ae66be783 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:34.230222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:34.235319 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-643bcca3-6391-4247-a45c-039ae66be783 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.165707 May 24 15:46:34.235909 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 465/881] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:34 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:34.359282 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-dd36ab9d-eb18-4d5c-b7db-5ca397dcc7d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:34.367724 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-dd36ab9d-eb18-4d5c-b7db-5ca397dcc7d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1556 microversion: 2.1 time: 0.169249 May 24 15:46:34.368364 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 417/882] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:34 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:34.384624 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2116c867-575f-4d05-82a8-9b975357a319 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:34.385110 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2116c867-575f-4d05-82a8-9b975357a319 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:34.393115 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2116c867-575f-4d05-82a8-9b975357a319 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:34.393595 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2116c867-575f-4d05-82a8-9b975357a319 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:34.394382 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2116c867-575f-4d05-82a8-9b975357a319 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:34.394811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2116c867-575f-4d05-82a8-9b975357a319 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:34.476192 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2116c867-575f-4d05-82a8-9b975357a319 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095440 May 24 15:46:34.476811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 466/883] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 24 15:46:34 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:34.909689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-75139953-89a9-4c00-a01b-d21cb6c55e77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:34.910389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-75139953-89a9-4c00-a01b-d21cb6c55e77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:34.918270 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75139953-89a9-4c00-a01b-d21cb6c55e77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:34.918965 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75139953-89a9-4c00-a01b-d21cb6c55e77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:34.920315 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75139953-89a9-4c00-a01b-d21cb6c55e77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:34.920904 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-75139953-89a9-4c00-a01b-d21cb6c55e77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:35.002352 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-75139953-89a9-4c00-a01b-d21cb6c55e77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:35.011496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-75139953-89a9-4c00-a01b-d21cb6c55e77 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1605 microversion: 2.1 time: 0.107117 May 24 15:46:35.012614 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 418/884] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:34 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1605 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:35.209185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-740eb34f-c9fd-4ab0-a13d-ebf9bd38718a req-60fbc5e1-0842-4547-a431-6863ef831ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38", "name": "network-vif-deleted", "tag": "fd56e978-8417-4a9e-9877-8bfb981aa335"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:35.221689 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-740eb34f-c9fd-4ab0-a13d-ebf9bd38718a req-60fbc5e1-0842-4547-a431-6863ef831ec7 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:35.222990 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-740eb34f-c9fd-4ab0-a13d-ebf9bd38718a req-60fbc5e1-0842-4547-a431-6863ef831ec7 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:35.245591 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-740eb34f-c9fd-4ab0-a13d-ebf9bd38718a req-60fbc5e1-0842-4547-a431-6863ef831ec7 service nova] Creating event network-vif-deleted:fd56e978-8417-4a9e-9877-8bfb981aa335 for instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 on hv-cinder-84315 May 24 15:46:35.251550 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-740eb34f-c9fd-4ab0-a13d-ebf9bd38718a req-60fbc5e1-0842-4547-a431-6863ef831ec7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046865 May 24 15:46:35.253230 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 467/885] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:35.254310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-98857bfc-a790-4591-bd50-7b8220ae768e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:35.254926 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-98857bfc-a790-4591-bd50-7b8220ae768e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:35.263092 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-98857bfc-a790-4591-bd50-7b8220ae768e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:35.263753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-98857bfc-a790-4591-bd50-7b8220ae768e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:35.265552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-98857bfc-a790-4591-bd50-7b8220ae768e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:35.267032 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-98857bfc-a790-4591-bd50-7b8220ae768e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:35.535632 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-98857bfc-a790-4591-bd50-7b8220ae768e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:35.543216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-98857bfc-a790-4591-bd50-7b8220ae768e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.294411 May 24 15:46:35.545102 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 419/886] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:35 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:35.566323 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-18c7eee0-aa1e-4a25-80c1-17fddfeaf9de req-dca5c3ad-6046-4808-aac8-2015b8a682bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efdad178-71c5-4ee8-ae88-eb20542da928", "tag": "f3394494-955a-46e9-83d3-82a4d8a8342f"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:35.575826 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-18c7eee0-aa1e-4a25-80c1-17fddfeaf9de req-dca5c3ad-6046-4808-aac8-2015b8a682bb service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:35.576318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-18c7eee0-aa1e-4a25-80c1-17fddfeaf9de req-dca5c3ad-6046-4808-aac8-2015b8a682bb service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:35.587536 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-18c7eee0-aa1e-4a25-80c1-17fddfeaf9de req-dca5c3ad-6046-4808-aac8-2015b8a682bb service nova] Creating event network-changed:f3394494-955a-46e9-83d3-82a4d8a8342f for instance efdad178-71c5-4ee8-ae88-eb20542da928 on hv-cinder-84315 May 24 15:46:35.593018 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-18c7eee0-aa1e-4a25-80c1-17fddfeaf9de req-dca5c3ad-6046-4808-aac8-2015b8a682bb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033534 May 24 15:46:35.593797 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 468/887] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:36.029619 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:36.030179 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:36.037047 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:36.037494 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:36.038260 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:36.038659 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:36.073076 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:36.073632 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:36.074121 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lazy-loading 'fault' on Instance uuid 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:46:36.117503 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:36.125605 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4e2d3677-35f3-4e50-a3a2-a0eb5e1943e3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 200 len: 1326 microversion: 2.1 time: 0.099836 May 24 15:46:36.126227 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 420/888] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:36 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:36.562262 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-65ad71cd-97ad-4c68-a2a5-b11b49da0183 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:36.563595 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-65ad71cd-97ad-4c68-a2a5-b11b49da0183 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:36.570146 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-65ad71cd-97ad-4c68-a2a5-b11b49da0183 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:36.570590 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-65ad71cd-97ad-4c68-a2a5-b11b49da0183 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:36.571313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-65ad71cd-97ad-4c68-a2a5-b11b49da0183 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:36.571915 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-65ad71cd-97ad-4c68-a2a5-b11b49da0183 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:36.725149 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-65ad71cd-97ad-4c68-a2a5-b11b49da0183 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:36.733012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-65ad71cd-97ad-4c68-a2a5-b11b49da0183 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.175357 May 24 15:46:36.733533 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 469/889] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:36 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:46:37.145481 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9fdb92ee-68bb-42ad-87c9-c101f01629f3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:37.146346 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9fdb92ee-68bb-42ad-87c9-c101f01629f3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:37.148883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:37.157116 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9fdb92ee-68bb-42ad-87c9-c101f01629f3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:37.157793 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9fdb92ee-68bb-42ad-87c9-c101f01629f3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:37.158603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9fdb92ee-68bb-42ad-87c9-c101f01629f3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:37.159086 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9fdb92ee-68bb-42ad-87c9-c101f01629f3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:37.173770 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-9fdb92ee-68bb-42ad-87c9-c101f01629f3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] HTTP exception thrown: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9fdb92ee-68bb-42ad-87c9-c101f01629f3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Request method failure captured: May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 HTTP/1.1 May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP0w4kcR4gjDWL0Rds7DQldrzW0uzA0JQrwOzP-El9r744pCpcfy_8uv1RHZ3XcTKs8V5L4_1g43rtXzrYFuWQosDI22wgr-AwtFcsW51BgZDMdb64Pr0DOmpNHXSn7hIAEzvIDoC7RpHTd8au5UJD6epo32tqLh_TCuWv9wgL0r2oo May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:46:37.175532 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeTestJSON-1944954544 May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: ad8f617cb0b14532b3ad514a0430e54f May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:46:37.177370 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': '307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38'} May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:46:37.178292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:46:37.179672 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:46:37.181013 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9fdb92ee-68bb-42ad-87c9-c101f01629f3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Returning 404 to user: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:46:37.181013 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9fdb92ee-68bb-42ad-87c9-c101f01629f3 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 404 len: 111 microversion: 2.1 time: 0.036939 May 24 15:46:37.181013 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 421/890] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:37 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:46:37.186531 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2ecda475-6d77-49d6-a652-968001ba5ce4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '.version_select at 0x7fb1d482c280>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:37.206141 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2ecda475-6d77-49d6-a652-968001ba5ce4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-402252766" status: 202 len: 0 microversion: 2.1 time: 0.023798 May 24 15:46:37.206845 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 470/891] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 24 15:46:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-402252766 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:46:37.749730 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b2caa51f-122a-45b5-8536-250692e1bf21 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:37.750334 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b2caa51f-122a-45b5-8536-250692e1bf21 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:37.753220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=14 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:37.757637 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b2caa51f-122a-45b5-8536-250692e1bf21 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:37.758102 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b2caa51f-122a-45b5-8536-250692e1bf21 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:37.758876 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b2caa51f-122a-45b5-8536-250692e1bf21 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:37.759304 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b2caa51f-122a-45b5-8536-250692e1bf21 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:37.867753 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-f4716d1f-f566-4ec7-9e56-7f6d48edfb44 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'create', calling method: .version_select at 0x7fb1d478f310>, body: {"keypair": {"name": "tempest-keypair-332295060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhfcXtjSsE3mHopQxEUO3lt3kihV7cxuUd4oeT23P88/U79CPVO0KiOmyQYlJr7VXIDiVItOr4fDFNDqAGbsFnEDAGfHJZyR3YOHEfulMihWjbpuqvo4Co7ykA+kI7JwA=="}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:37.883239 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-f4716d1f-f566-4ec7-9e56-7f6d48edfb44 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Getting quotas for project f92c7d44a8de4b2ab85ab081276300fd. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:46:37.887653 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-f4716d1f-f566-4ec7-9e56-7f6d48edfb44 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Getting quotas for user ad8f617cb0b14532b3ad514a0430e54f and project f92c7d44a8de4b2ab85ab081276300fd. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:46:37.908596 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b2caa51f-122a-45b5-8536-250692e1bf21 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:37.911231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-f4716d1f-f566-4ec7-9e56-7f6d48edfb44 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047284 May 24 15:46:37.912176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 471/892] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 24 15:46:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:37.916386 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b2caa51f-122a-45b5-8536-250692e1bf21 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.170388 May 24 15:46:37.920169 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 422/893] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:37 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:38.934136 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-652f6536-4818-4429-9c69-18fc0beaca1e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:38.936256 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-652f6536-4818-4429-9c69-18fc0beaca1e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:38.945654 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-652f6536-4818-4429-9c69-18fc0beaca1e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:38.946921 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-652f6536-4818-4429-9c69-18fc0beaca1e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:38.948188 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-652f6536-4818-4429-9c69-18fc0beaca1e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:38.948643 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-652f6536-4818-4429-9c69-18fc0beaca1e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:39.180239 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-652f6536-4818-4429-9c69-18fc0beaca1e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:39.187864 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-652f6536-4818-4429-9c69-18fc0beaca1e tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.258329 May 24 15:46:39.188449 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 472/894] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:38 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:39.288295 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1046687684", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0609c63-82a5-45e5-be15-292af1dcfb75"}], "security_groups": [{"name": "tempest-securitygroup--947184448"}], "key_name": "tempest-keypair-332295060", "user_data": "}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:39.391725 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.network.neutron [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] validate_networks() for [('a0609c63-82a5-45e5-be15-292af1dcfb75', None, None, None, None, None)] {{(pid=129339) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:46:39.765018 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Flavor limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:46:39.765463 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Image limits 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:46:39.765928 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Flavor pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:46:39.766330 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Image pref 0:0:0 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:46:39.766736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.virt.hardware [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:46:39.775785 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:39.776264 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:39.777044 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:39.777474 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:39.793746 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Getting quotas for project f92c7d44a8de4b2ab85ab081276300fd. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:46:39.797720 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Getting quotas for user ad8f617cb0b14532b3ad514a0430e54f and project f92c7d44a8de4b2ab85ab081276300fd. Resources: {'instances', 'ram', 'cores'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:46:39.808718 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Going to run 1 instances... {{(pid=129339) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:46:39.810952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:46:39.861361 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c997249b-01a6-49e2-89df-7dd2101c2161 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.577297 May 24 15:46:39.862205 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 423/895] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:46:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:46:39.872059 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7b63fbca-047c-47ad-83e9-5f5771ab2372 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:39.872675 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7b63fbca-047c-47ad-83e9-5f5771ab2372 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:39.925827 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-7b63fbca-047c-47ad-83e9-5f5771ab2372 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:39.933229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7b63fbca-047c-47ad-83e9-5f5771ab2372 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1237 microversion: 2.1 time: 0.065084 May 24 15:46:39.933792 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 473/896] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:39 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:40.206176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-35050bc5-3e5a-4329-a53f-a5ef3fd7c223 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:40.206793 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-35050bc5-3e5a-4329-a53f-a5ef3fd7c223 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:40.208741 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:40.214552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-35050bc5-3e5a-4329-a53f-a5ef3fd7c223 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:40.215075 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-35050bc5-3e5a-4329-a53f-a5ef3fd7c223 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:40.215944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-35050bc5-3e5a-4329-a53f-a5ef3fd7c223 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:40.216411 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-35050bc5-3e5a-4329-a53f-a5ef3fd7c223 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:40.235992 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=100 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:40.620684 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-35050bc5-3e5a-4329-a53f-a5ef3fd7c223 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:40.632371 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-35050bc5-3e5a-4329-a53f-a5ef3fd7c223 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.430634 May 24 15:46:40.633149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 424/897] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:40 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:40.950589 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3261b974-c2de-4de4-9233-a0ef17f19bc6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:40.951996 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3261b974-c2de-4de4-9233-a0ef17f19bc6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:40.959994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3261b974-c2de-4de4-9233-a0ef17f19bc6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:40.961917 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3261b974-c2de-4de4-9233-a0ef17f19bc6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:40.963266 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3261b974-c2de-4de4-9233-a0ef17f19bc6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:40.964435 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3261b974-c2de-4de4-9233-a0ef17f19bc6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:41.009864 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-9fcfbff6-8c36-428b-87f0-b63a91fc0df7 req-c5b33989-b750-4a96-b8da-d54580473527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f052d1b5-52db-4a7f-9455-19439d077d63", "name": "network-vif-plugged", "status": "completed", "tag": "32c2c21f-098c-426f-a69f-e6795e6db5ba"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:41.036790 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-9fcfbff6-8c36-428b-87f0-b63a91fc0df7 req-c5b33989-b750-4a96-b8da-d54580473527 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:41.037574 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-9fcfbff6-8c36-428b-87f0-b63a91fc0df7 req-c5b33989-b750-4a96-b8da-d54580473527 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:41.065464 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3261b974-c2de-4de4-9233-a0ef17f19bc6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:41.068815 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-9fcfbff6-8c36-428b-87f0-b63a91fc0df7 req-c5b33989-b750-4a96-b8da-d54580473527 service nova] Creating event network-vif-plugged:32c2c21f-098c-426f-a69f-e6795e6db5ba for instance f052d1b5-52db-4a7f-9455-19439d077d63 on hv-cinder-84315 May 24 15:46:41.075624 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-9fcfbff6-8c36-428b-87f0-b63a91fc0df7 req-c5b33989-b750-4a96-b8da-d54580473527 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069311 May 24 15:46:41.076805 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 425/898] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:46:41.077285 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3261b974-c2de-4de4-9233-a0ef17f19bc6 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1307 microversion: 2.1 time: 0.130453 May 24 15:46:41.078140 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 474/899] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:40 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:41.654311 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-50f2af8b-b173-425c-9e5d-9a7a6f229476 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:41.654981 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-50f2af8b-b173-425c-9e5d-9a7a6f229476 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:41.661559 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-50f2af8b-b173-425c-9e5d-9a7a6f229476 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:41.662001 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-50f2af8b-b173-425c-9e5d-9a7a6f229476 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:41.662781 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-50f2af8b-b173-425c-9e5d-9a7a6f229476 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:41.663383 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-50f2af8b-b173-425c-9e5d-9a7a6f229476 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:41.805026 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-50f2af8b-b173-425c-9e5d-9a7a6f229476 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:41.829600 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-50f2af8b-b173-425c-9e5d-9a7a6f229476 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.179684 May 24 15:46:41.835536 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 426/900] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:41 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:42.098886 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2392c899-80d9-48b2-84ac-6d0d02825969 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:42.099743 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2392c899-80d9-48b2-84ac-6d0d02825969 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:42.103782 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:42.112116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2392c899-80d9-48b2-84ac-6d0d02825969 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:42.112552 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2392c899-80d9-48b2-84ac-6d0d02825969 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:42.113309 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2392c899-80d9-48b2-84ac-6d0d02825969 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:42.113731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2392c899-80d9-48b2-84ac-6d0d02825969 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:42.246987 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2392c899-80d9-48b2-84ac-6d0d02825969 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:42.254924 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2392c899-80d9-48b2-84ac-6d0d02825969 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1362 microversion: 2.1 time: 0.162666 May 24 15:46:42.255468 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 475/901] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:42 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:42.763045 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-f7c98cbb-8f21-427e-aaa7-dc96d4cfb353 req-999f1474-0a0f-4caf-9464-c16423156ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8bae040-4604-4b06-ac56-e79ff91c5b44", "tag": "45ec7467-59d5-4ea2-94ad-078af0dc4ea3"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:42.771636 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-f7c98cbb-8f21-427e-aaa7-dc96d4cfb353 req-999f1474-0a0f-4caf-9464-c16423156ebd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:42.772354 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-f7c98cbb-8f21-427e-aaa7-dc96d4cfb353 req-999f1474-0a0f-4caf-9464-c16423156ebd service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:42.784252 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-f7c98cbb-8f21-427e-aaa7-dc96d4cfb353 req-999f1474-0a0f-4caf-9464-c16423156ebd service nova] Creating event network-changed:45ec7467-59d5-4ea2-94ad-078af0dc4ea3 for instance a8bae040-4604-4b06-ac56-e79ff91c5b44 on hv-cinder-84315 May 24 15:46:42.790920 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-f7c98cbb-8f21-427e-aaa7-dc96d4cfb353 req-999f1474-0a0f-4caf-9464-c16423156ebd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032223 May 24 15:46:42.791831 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 427/902] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:42.846521 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d000f41b-395b-4db6-98ad-4bfc19c2bd1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:42.847135 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d000f41b-395b-4db6-98ad-4bfc19c2bd1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:42.853740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d000f41b-395b-4db6-98ad-4bfc19c2bd1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:42.854181 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d000f41b-395b-4db6-98ad-4bfc19c2bd1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:42.854956 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d000f41b-395b-4db6-98ad-4bfc19c2bd1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:42.855385 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d000f41b-395b-4db6-98ad-4bfc19c2bd1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:43.014540 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d000f41b-395b-4db6-98ad-4bfc19c2bd1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:43.022563 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d000f41b-395b-4db6-98ad-4bfc19c2bd1d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1265 microversion: 2.1 time: 0.180225 May 24 15:46:43.023131 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 476/903] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:42 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:43.276088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f3e748b5-daa5-426a-86a9-5c67b5f4773a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:43.277000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f3e748b5-daa5-426a-86a9-5c67b5f4773a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:43.285054 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3e748b5-daa5-426a-86a9-5c67b5f4773a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:43.285499 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3e748b5-daa5-426a-86a9-5c67b5f4773a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:43.286265 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3e748b5-daa5-426a-86a9-5c67b5f4773a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:43.286863 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f3e748b5-daa5-426a-86a9-5c67b5f4773a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:43.416892 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f3e748b5-daa5-426a-86a9-5c67b5f4773a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:43.424761 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f3e748b5-daa5-426a-86a9-5c67b5f4773a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1362 microversion: 2.1 time: 0.155166 May 24 15:46:43.425329 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 428/904] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:43 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:44.041773 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-bc6910a7-f6ff-46f6-9c97-0f0f111fd1cd tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:44.042660 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-bc6910a7-f6ff-46f6-9c97-0f0f111fd1cd tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:44.053078 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc6910a7-f6ff-46f6-9c97-0f0f111fd1cd tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:44.053813 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc6910a7-f6ff-46f6-9c97-0f0f111fd1cd tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:44.054936 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc6910a7-f6ff-46f6-9c97-0f0f111fd1cd tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:44.055596 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-bc6910a7-f6ff-46f6-9c97-0f0f111fd1cd tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:44.204793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-bc6910a7-f6ff-46f6-9c97-0f0f111fd1cd tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:44.213589 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-bc6910a7-f6ff-46f6-9c97-0f0f111fd1cd tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1451 microversion: 2.1 time: 0.177553 May 24 15:46:44.214128 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 477/905] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:44 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:44.237839 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-aeae5801-7ff1-4acb-9db3-4b11762d18f9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:44.238452 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-aeae5801-7ff1-4acb-9db3-4b11762d18f9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:44.245103 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aeae5801-7ff1-4acb-9db3-4b11762d18f9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:44.245551 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aeae5801-7ff1-4acb-9db3-4b11762d18f9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:44.246302 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aeae5801-7ff1-4acb-9db3-4b11762d18f9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:44.246758 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aeae5801-7ff1-4acb-9db3-4b11762d18f9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:44.381788 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-aeae5801-7ff1-4acb-9db3-4b11762d18f9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:44.394382 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-aeae5801-7ff1-4acb-9db3-4b11762d18f9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1451 microversion: 2.1 time: 0.161831 May 24 15:46:44.394956 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 429/906] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:44 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:44.441863 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-865c8d0e-209c-49d5-9731-1789cf24fae9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:44.442574 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-865c8d0e-209c-49d5-9731-1789cf24fae9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:44.449064 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-865c8d0e-209c-49d5-9731-1789cf24fae9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:44.449849 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-865c8d0e-209c-49d5-9731-1789cf24fae9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:44.450485 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-865c8d0e-209c-49d5-9731-1789cf24fae9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:44.450980 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-865c8d0e-209c-49d5-9731-1789cf24fae9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:44.582583 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-865c8d0e-209c-49d5-9731-1789cf24fae9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:44.590217 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-865c8d0e-209c-49d5-9731-1789cf24fae9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1362 microversion: 2.1 time: 0.152479 May 24 15:46:44.590972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 478/907] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:44 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:45.607106 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c3909c0a-6114-46fd-8091-236c5eaa9426 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:45.607792 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c3909c0a-6114-46fd-8091-236c5eaa9426 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:45.615165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c3909c0a-6114-46fd-8091-236c5eaa9426 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:45.615856 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c3909c0a-6114-46fd-8091-236c5eaa9426 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:45.616656 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c3909c0a-6114-46fd-8091-236c5eaa9426 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:45.617086 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c3909c0a-6114-46fd-8091-236c5eaa9426 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:45.759771 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c3909c0a-6114-46fd-8091-236c5eaa9426 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:45.768325 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c3909c0a-6114-46fd-8091-236c5eaa9426 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1362 microversion: 2.1 time: 0.165014 May 24 15:46:45.769227 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 430/908] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:45 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:46.038407 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-d6d1f456-0a1e-4e4c-9e0a-552d441382bf req-1017b028-3027-4a73-be7f-0b8d348eacea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f052d1b5-52db-4a7f-9455-19439d077d63", "tag": "32c2c21f-098c-426f-a69f-e6795e6db5ba"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:46.047149 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-d6d1f456-0a1e-4e4c-9e0a-552d441382bf req-1017b028-3027-4a73-be7f-0b8d348eacea service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:46.047599 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-d6d1f456-0a1e-4e4c-9e0a-552d441382bf req-1017b028-3027-4a73-be7f-0b8d348eacea service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:46.061878 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-d6d1f456-0a1e-4e4c-9e0a-552d441382bf req-1017b028-3027-4a73-be7f-0b8d348eacea service nova] Creating event network-changed:32c2c21f-098c-426f-a69f-e6795e6db5ba for instance f052d1b5-52db-4a7f-9455-19439d077d63 on hv-cinder-84315 May 24 15:46:46.067376 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-d6d1f456-0a1e-4e4c-9e0a-552d441382bf req-1017b028-3027-4a73-be7f-0b8d348eacea service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032715 May 24 15:46:46.067972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 479/909] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:46.788841 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c0f89385-08db-40bd-94cf-dc144d345d45 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:46.789496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c0f89385-08db-40bd-94cf-dc144d345d45 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:46.796361 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c0f89385-08db-40bd-94cf-dc144d345d45 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:46.796813 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c0f89385-08db-40bd-94cf-dc144d345d45 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:46.797579 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c0f89385-08db-40bd-94cf-dc144d345d45 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:46.798039 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c0f89385-08db-40bd-94cf-dc144d345d45 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:46.938114 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c0f89385-08db-40bd-94cf-dc144d345d45 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:46.947397 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c0f89385-08db-40bd-94cf-dc144d345d45 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1362 microversion: 2.1 time: 0.162539 May 24 15:46:46.947965 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 431/910] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:46 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:47.965070 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4a05841a-3ed7-4c69-80bd-455efbe91692 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:47.965766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-4a05841a-3ed7-4c69-80bd-455efbe91692 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:47.972970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4a05841a-3ed7-4c69-80bd-455efbe91692 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:47.973423 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4a05841a-3ed7-4c69-80bd-455efbe91692 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:47.974185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4a05841a-3ed7-4c69-80bd-455efbe91692 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:47.974612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4a05841a-3ed7-4c69-80bd-455efbe91692 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:48.123746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-4a05841a-3ed7-4c69-80bd-455efbe91692 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:48.136187 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-4a05841a-3ed7-4c69-80bd-455efbe91692 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1362 microversion: 2.1 time: 0.175137 May 24 15:46:48.136809 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 480/911] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:47 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:49.019375 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-96018313-a2f3-4e79-a346-ff727ddafeb7 req-5f4f4c39-f26d-4bf4-9294-0335c27e823d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bae040-4604-4b06-ac56-e79ff91c5b44", "name": "network-vif-plugged", "status": "completed", "tag": "45ec7467-59d5-4ea2-94ad-078af0dc4ea3"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:49.029426 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-96018313-a2f3-4e79-a346-ff727ddafeb7 req-5f4f4c39-f26d-4bf4-9294-0335c27e823d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:49.030073 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-96018313-a2f3-4e79-a346-ff727ddafeb7 req-5f4f4c39-f26d-4bf4-9294-0335c27e823d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:49.043214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-96018313-a2f3-4e79-a346-ff727ddafeb7 req-5f4f4c39-f26d-4bf4-9294-0335c27e823d service nova] Creating event network-vif-plugged:45ec7467-59d5-4ea2-94ad-078af0dc4ea3 for instance a8bae040-4604-4b06-ac56-e79ff91c5b44 on hv-cinder-84315 May 24 15:46:49.048662 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-96018313-a2f3-4e79-a346-ff727ddafeb7 req-5f4f4c39-f26d-4bf4-9294-0335c27e823d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032939 May 24 15:46:49.049152 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 432/912] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:49.155253 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-10b01bf9-94de-46c9-b6c1-cc784462b778 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:49.155938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-10b01bf9-94de-46c9-b6c1-cc784462b778 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:49.163199 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-10b01bf9-94de-46c9-b6c1-cc784462b778 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:49.163646 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-10b01bf9-94de-46c9-b6c1-cc784462b778 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:49.164441 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-10b01bf9-94de-46c9-b6c1-cc784462b778 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:49.164885 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-10b01bf9-94de-46c9-b6c1-cc784462b778 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:49.295144 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-10b01bf9-94de-46c9-b6c1-cc784462b778 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:49.302767 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-10b01bf9-94de-46c9-b6c1-cc784462b778 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1362 microversion: 2.1 time: 0.151608 May 24 15:46:49.303326 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 481/913] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:49 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:50.320872 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-58d791e6-9bd3-4ae8-8de7-0e193a401b48 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:50.321568 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-58d791e6-9bd3-4ae8-8de7-0e193a401b48 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:50.323756 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:50.324428 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=6 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:50.330958 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-58d791e6-9bd3-4ae8-8de7-0e193a401b48 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:50.331396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-58d791e6-9bd3-4ae8-8de7-0e193a401b48 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:50.332179 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-58d791e6-9bd3-4ae8-8de7-0e193a401b48 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:50.332603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-58d791e6-9bd3-4ae8-8de7-0e193a401b48 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:50.467602 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-58d791e6-9bd3-4ae8-8de7-0e193a401b48 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:50.475401 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-58d791e6-9bd3-4ae8-8de7-0e193a401b48 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1362 microversion: 2.1 time: 0.159134 May 24 15:46:50.475970 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 433/914] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:50 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:51.497752 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a50a2f74-39d6-45e9-99b3-aea5421c6d95 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:51.498355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a50a2f74-39d6-45e9-99b3-aea5421c6d95 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:51.501529 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=6 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:46:51.505797 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a50a2f74-39d6-45e9-99b3-aea5421c6d95 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:51.506284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a50a2f74-39d6-45e9-99b3-aea5421c6d95 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:51.507083 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a50a2f74-39d6-45e9-99b3-aea5421c6d95 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:51.507512 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a50a2f74-39d6-45e9-99b3-aea5421c6d95 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:51.651191 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a50a2f74-39d6-45e9-99b3-aea5421c6d95 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:46:51.659331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a50a2f74-39d6-45e9-99b3-aea5421c6d95 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1548 microversion: 2.1 time: 0.165518 May 24 15:46:51.659904 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 482/915] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:46:51 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:46:51.675689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6ce91585-0e19-4229-aadd-37b7b26f0db4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:46:51.676264 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6ce91585-0e19-4229-aadd-37b7b26f0db4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:46:51.682817 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6ce91585-0e19-4229-aadd-37b7b26f0db4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:51.683255 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6ce91585-0e19-4229-aadd-37b7b26f0db4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:51.684014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6ce91585-0e19-4229-aadd-37b7b26f0db4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:51.684466 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6ce91585-0e19-4229-aadd-37b7b26f0db4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:51.762045 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6ce91585-0e19-4229-aadd-37b7b26f0db4 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090238 May 24 15:46:51.762951 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 434/916] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 24 15:46:51 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:46:52.736632 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-72eee55f-e3ac-4f6e-96f0-7f5dc4bb71e3 req-f6bfeaa2-09f1-454a-a8b8-0d326d157594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8bae040-4604-4b06-ac56-e79ff91c5b44", "tag": "45ec7467-59d5-4ea2-94ad-078af0dc4ea3"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:46:52.745525 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-72eee55f-e3ac-4f6e-96f0-7f5dc4bb71e3 req-f6bfeaa2-09f1-454a-a8b8-0d326d157594 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:46:52.745951 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-72eee55f-e3ac-4f6e-96f0-7f5dc4bb71e3 req-f6bfeaa2-09f1-454a-a8b8-0d326d157594 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:46:52.757940 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-72eee55f-e3ac-4f6e-96f0-7f5dc4bb71e3 req-f6bfeaa2-09f1-454a-a8b8-0d326d157594 service nova] Creating event network-changed:45ec7467-59d5-4ea2-94ad-078af0dc4ea3 for instance a8bae040-4604-4b06-ac56-e79ff91c5b44 on hv-cinder-84315 May 24 15:46:52.764265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-72eee55f-e3ac-4f6e-96f0-7f5dc4bb71e3 req-f6bfeaa2-09f1-454a-a8b8-0d326d157594 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031381 May 24 15:46:52.764938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 483/917] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:11.805231 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=21 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:11.806007 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=48 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:11.810058 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6e7a6d38-0ffb-4bd5-bfae-752bde470776 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:11.810546 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6e7a6d38-0ffb-4bd5-bfae-752bde470776 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:11.818020 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6e7a6d38-0ffb-4bd5-bfae-752bde470776 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:11.818455 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6e7a6d38-0ffb-4bd5-bfae-752bde470776 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:11.819206 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6e7a6d38-0ffb-4bd5-bfae-752bde470776 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:11.819633 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6e7a6d38-0ffb-4bd5-bfae-752bde470776 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:11.846824 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6e7a6d38-0ffb-4bd5-bfae-752bde470776 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928/ips" status: 200 len: 149 microversion: 2.1 time: 0.042229 May 24 15:47:11.847416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 435/918] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 24 15:47:11 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:11.864022 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e8af534e-e872-4601-80b0-4b97d717a842 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e62d900-390c-4f06-9fb4-afe738a104f6"}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:11.865970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e8af534e-e872-4601-80b0-4b97d717a842 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:11.869601 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=17 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:11.870663 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=72 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:11.879513 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e8af534e-e872-4601-80b0-4b97d717a842 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:11.879959 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e8af534e-e872-4601-80b0-4b97d717a842 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:11.880750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e8af534e-e872-4601-80b0-4b97d717a842 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:11.881175 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e8af534e-e872-4601-80b0-4b97d717a842 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:11.963833 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-e8af534e-e872-4601-80b0-4b97d717a842 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Invalid volume: volume 2e62d900-390c-4f06-9fb4-afe738a104f6 is already attached to instances: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e8af534e-e872-4601-80b0-4b97d717a842 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: POST /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928/os-volume_attachments HTTP/1.1 May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 74 May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:47:11.965605 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {"volumeAttachment": {"volumeId": "2e62d900-390c-4f06-9fb4-afe738a104f6"}} May 24 15:47:11.967248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Invalid volume: volume 2e62d900-390c-4f06-9fb4-afe738a104f6 is already attached to instances: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'server_id': 'efdad178-71c5-4ee8-ae88-eb20542da928', 'body': {'volumeAttachment': {'volumeId': '2e62d900-390c-4f06-9fb4-afe738a104f6'}}} May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2e62d900-390c-4f06-9fb4-afe738a104f6 is already attached to instances: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:47:11.968325 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2e62d900-390c-4f06-9fb4-afe738a104f6 is already attached to instances: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:11.970301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:11.971982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:11.971982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:47:11.971982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:47:11.971982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2e62d900-390c-4f06-9fb4-afe738a104f6 is already attached to instances: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d May 24 15:47:11.971982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:47:11.971982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e8af534e-e872-4601-80b0-4b97d717a842 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 400 to user: Invalid volume: volume 2e62d900-390c-4f06-9fb4-afe738a104f6 is already attached to instances: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:47:11.971982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e8af534e-e872-4601-80b0-4b97d717a842 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110309 May 24 15:47:11.971982 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 484/919] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:47:11 2022] POST /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 15:47:11.976482 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1dd6c609-2c5d-4128-9e0a-9ccf5056fcb0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:11.977003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1dd6c609-2c5d-4128-9e0a-9ccf5056fcb0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:11.983437 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1dd6c609-2c5d-4128-9e0a-9ccf5056fcb0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:11.983868 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1dd6c609-2c5d-4128-9e0a-9ccf5056fcb0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:11.984872 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1dd6c609-2c5d-4128-9e0a-9ccf5056fcb0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:11.985212 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1dd6c609-2c5d-4128-9e0a-9ccf5056fcb0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:12.010870 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1dd6c609-2c5d-4128-9e0a-9ccf5056fcb0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:47:12.096729 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1dd6c609-2c5d-4128-9e0a-9ccf5056fcb0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 204 len: 0 microversion: 2.1 time: 0.123875 May 24 15:47:12.097336 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 436/920] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:47:11 2022] DELETE /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:47:12.106580 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-25cb8569-7326-46cd-bf8b-6896ab3b152a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:12.107386 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-25cb8569-7326-46cd-bf8b-6896ab3b152a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:12.115618 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-25cb8569-7326-46cd-bf8b-6896ab3b152a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:12.116074 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-25cb8569-7326-46cd-bf8b-6896ab3b152a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:12.116880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-25cb8569-7326-46cd-bf8b-6896ab3b152a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:12.117474 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-25cb8569-7326-46cd-bf8b-6896ab3b152a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:12.257222 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-25cb8569-7326-46cd-bf8b-6896ab3b152a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:12.265390 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-25cb8569-7326-46cd-bf8b-6896ab3b152a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1681 microversion: 2.1 time: 0.162961 May 24 15:47:12.265950 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 485/921] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:12 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:13.288134 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d2883836-f86d-4f03-9348-792d0e1ae9aa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:13.289327 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d2883836-f86d-4f03-9348-792d0e1ae9aa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:13.300474 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d2883836-f86d-4f03-9348-792d0e1ae9aa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:13.301206 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d2883836-f86d-4f03-9348-792d0e1ae9aa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:13.302470 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d2883836-f86d-4f03-9348-792d0e1ae9aa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:13.303181 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d2883836-f86d-4f03-9348-792d0e1ae9aa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:13.452735 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-d2883836-f86d-4f03-9348-792d0e1ae9aa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:13.460435 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d2883836-f86d-4f03-9348-792d0e1ae9aa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1681 microversion: 2.1 time: 0.179635 May 24 15:47:13.460985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 437/922] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:13 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:14.481090 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6632048d-3347-4177-b8ea-af1c4ee01f67 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:14.482092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6632048d-3347-4177-b8ea-af1c4ee01f67 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:14.493981 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6632048d-3347-4177-b8ea-af1c4ee01f67 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:14.494679 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6632048d-3347-4177-b8ea-af1c4ee01f67 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:14.495962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6632048d-3347-4177-b8ea-af1c4ee01f67 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:14.496709 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6632048d-3347-4177-b8ea-af1c4ee01f67 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:14.639755 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6632048d-3347-4177-b8ea-af1c4ee01f67 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:14.647994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6632048d-3347-4177-b8ea-af1c4ee01f67 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1681 microversion: 2.1 time: 0.173395 May 24 15:47:14.648621 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 486/923] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:14 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:15.584052 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-502bc3d3-2d76-4df8-9cc7-11c7c88ff390 req-9cc2d80b-f46b-4125-8a81-e9e12e1f8566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdad178-71c5-4ee8-ae88-eb20542da928", "name": "network-vif-deleted", "tag": "f3394494-955a-46e9-83d3-82a4d8a8342f"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:15.592541 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-502bc3d3-2d76-4df8-9cc7-11c7c88ff390 req-9cc2d80b-f46b-4125-8a81-e9e12e1f8566 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:15.592975 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-502bc3d3-2d76-4df8-9cc7-11c7c88ff390 req-9cc2d80b-f46b-4125-8a81-e9e12e1f8566 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:15.610115 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-502bc3d3-2d76-4df8-9cc7-11c7c88ff390 req-9cc2d80b-f46b-4125-8a81-e9e12e1f8566 service nova] Creating event network-vif-deleted:f3394494-955a-46e9-83d3-82a4d8a8342f for instance efdad178-71c5-4ee8-ae88-eb20542da928 on hv-cinder-84315 May 24 15:47:15.616079 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-502bc3d3-2d76-4df8-9cc7-11c7c88ff390 req-9cc2d80b-f46b-4125-8a81-e9e12e1f8566 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036193 May 24 15:47:15.616682 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 438/924] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:15.665864 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3bc60607-20a5-4dc7-a089-602ada5d4d7b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:15.666385 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3bc60607-20a5-4dc7-a089-602ada5d4d7b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:15.675278 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3bc60607-20a5-4dc7-a089-602ada5d4d7b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:15.676134 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3bc60607-20a5-4dc7-a089-602ada5d4d7b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:15.677139 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3bc60607-20a5-4dc7-a089-602ada5d4d7b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:15.677847 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3bc60607-20a5-4dc7-a089-602ada5d4d7b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:15.752109 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-3bc60607-20a5-4dc7-a089-602ada5d4d7b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:15.760720 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3bc60607-20a5-4dc7-a089-602ada5d4d7b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 200 len: 1326 microversion: 2.1 time: 0.098861 May 24 15:47:15.761307 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 487/925] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:15 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:16.784267 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-967425b2-59d9-45c4-84e6-7a30452b27e2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:16.785312 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-967425b2-59d9-45c4-84e6-7a30452b27e2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:16.795475 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-967425b2-59d9-45c4-84e6-7a30452b27e2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:16.796245 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-967425b2-59d9-45c4-84e6-7a30452b27e2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:16.797486 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-967425b2-59d9-45c4-84e6-7a30452b27e2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:16.798195 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-967425b2-59d9-45c4-84e6-7a30452b27e2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:16.816677 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-967425b2-59d9-45c4-84e6-7a30452b27e2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-967425b2-59d9-45c4-84e6-7a30452b27e2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 HTTP/1.1 May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:47:16.818328 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:47:16.819845 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'efdad178-71c5-4ee8-ae88-eb20542da928'} May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:47:16.820773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:47:16.822176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:16.823489 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-967425b2-59d9-45c4-84e6-7a30452b27e2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:47:16.823489 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-967425b2-59d9-45c4-84e6-7a30452b27e2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 404 len: 111 microversion: 2.1 time: 0.043348 May 24 15:47:16.823489 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 439/926] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:16 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:47:16.828897 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3220ad83-c0d9-4547-b18c-b08b57c1c0e0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '.version_select at 0x7fb1d48e9d30>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:16.851140 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3220ad83-c0d9-4547-b18c-b08b57c1c0e0 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401170325" status: 202 len: 0 microversion: 2.1 time: 0.026126 May 24 15:47:16.851717 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 488/927] 10.222.0.55 () {58 vars in 1220 bytes} [Tue May 24 15:47:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401170325 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:47:17.536790 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2949e703-79ea-4167-ba14-5fc5e2621890 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:17.537284 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2949e703-79ea-4167-ba14-5fc5e2621890 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:17.543632 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2949e703-79ea-4167-ba14-5fc5e2621890 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:17.544075 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2949e703-79ea-4167-ba14-5fc5e2621890 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:17.544851 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2949e703-79ea-4167-ba14-5fc5e2621890 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:17.545274 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2949e703-79ea-4167-ba14-5fc5e2621890 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:17.630154 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-2949e703-79ea-4167-ba14-5fc5e2621890 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lazy-loading 'services' on Instance uuid b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:47:17.703513 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2949e703-79ea-4167-ba14-5fc5e2621890 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/os-volume_attachments/2e62d900-390c-4f06-9fb4-afe738a104f6" status: 202 len: 0 microversion: 2.1 time: 0.170820 May 24 15:47:17.704130 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 440/928] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:47:17 2022] DELETE /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/os-volume_attachments/2e62d900-390c-4f06-9fb4-afe738a104f6 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:47:17.713161 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-21ca4a66-0920-43b5-a179-bed503af8d66 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:17.714110 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-21ca4a66-0920-43b5-a179-bed503af8d66 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:17.721409 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21ca4a66-0920-43b5-a179-bed503af8d66 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:17.721909 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21ca4a66-0920-43b5-a179-bed503af8d66 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:17.722904 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21ca4a66-0920-43b5-a179-bed503af8d66 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:17.723331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-21ca4a66-0920-43b5-a179-bed503af8d66 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:17.755302 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-21ca4a66-0920-43b5-a179-bed503af8d66 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046837 May 24 15:47:17.755841 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 489/929] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:47:17 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:18.771520 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-133e2da6-21bd-4ce3-9f95-a43a96731e74 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:18.772545 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-133e2da6-21bd-4ce3-9f95-a43a96731e74 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:18.779405 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-133e2da6-21bd-4ce3-9f95-a43a96731e74 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:18.779847 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-133e2da6-21bd-4ce3-9f95-a43a96731e74 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:18.780644 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-133e2da6-21bd-4ce3-9f95-a43a96731e74 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:18.781063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-133e2da6-21bd-4ce3-9f95-a43a96731e74 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:18.812000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-133e2da6-21bd-4ce3-9f95-a43a96731e74 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047028 May 24 15:47:18.812575 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 441/930] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:47:18 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:47:18.883863 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cb018d59-c9d1-4705-a1b4-421b495b81d6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:18.884417 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-cb018d59-c9d1-4705-a1b4-421b495b81d6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:18.891293 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cb018d59-c9d1-4705-a1b4-421b495b81d6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:18.891746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cb018d59-c9d1-4705-a1b4-421b495b81d6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:18.892536 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cb018d59-c9d1-4705-a1b4-421b495b81d6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:18.892971 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cb018d59-c9d1-4705-a1b4-421b495b81d6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:18.919827 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-cb018d59-c9d1-4705-a1b4-421b495b81d6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Going to try to terminate instance {{(pid=129340) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:47:19.002294 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cb018d59-c9d1-4705-a1b4-421b495b81d6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 204 len: 0 microversion: 2.1 time: 0.122133 May 24 15:47:19.003332 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 490/931] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:47:18 2022] DELETE /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:47:19.011408 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-85a8d67d-d6af-457a-959d-05574c5212e9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:19.012021 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-85a8d67d-d6af-457a-959d-05574c5212e9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:19.018635 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-85a8d67d-d6af-457a-959d-05574c5212e9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:19.019076 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-85a8d67d-d6af-457a-959d-05574c5212e9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:19.019833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-85a8d67d-d6af-457a-959d-05574c5212e9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:19.020330 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-85a8d67d-d6af-457a-959d-05574c5212e9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:19.160053 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-85a8d67d-d6af-457a-959d-05574c5212e9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:19.167618 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-85a8d67d-d6af-457a-959d-05574c5212e9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1679 microversion: 2.1 time: 0.160014 May 24 15:47:19.168202 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 442/932] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:19 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:20.190037 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d0a0f3a6-1259-4912-b3c3-89b00aeb6850 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:20.191411 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d0a0f3a6-1259-4912-b3c3-89b00aeb6850 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:20.202285 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0a0f3a6-1259-4912-b3c3-89b00aeb6850 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:20.203011 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0a0f3a6-1259-4912-b3c3-89b00aeb6850 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:20.204381 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0a0f3a6-1259-4912-b3c3-89b00aeb6850 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:20.205081 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d0a0f3a6-1259-4912-b3c3-89b00aeb6850 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:20.348689 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-d0a0f3a6-1259-4912-b3c3-89b00aeb6850 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:20.358740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d0a0f3a6-1259-4912-b3c3-89b00aeb6850 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1679 microversion: 2.1 time: 0.175799 May 24 15:47:20.359312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 491/933] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:20 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:21.376231 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-033a2b38-fc8c-46bc-9a58-1da93fee2cda tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:21.376941 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-033a2b38-fc8c-46bc-9a58-1da93fee2cda tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:21.384301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-033a2b38-fc8c-46bc-9a58-1da93fee2cda tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:21.384725 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-033a2b38-fc8c-46bc-9a58-1da93fee2cda tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:21.385477 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-033a2b38-fc8c-46bc-9a58-1da93fee2cda tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:21.385896 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-033a2b38-fc8c-46bc-9a58-1da93fee2cda tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:21.520705 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-033a2b38-fc8c-46bc-9a58-1da93fee2cda tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:21.531483 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-033a2b38-fc8c-46bc-9a58-1da93fee2cda tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 200 len: 1679 microversion: 2.1 time: 0.159077 May 24 15:47:21.532097 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 443/934] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:21 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:21.805534 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-806057bb-2d34-4c23-8b33-1409172164b2 req-534d486b-7755-4c7d-bb34-f85e80cf1f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d", "name": "network-vif-deleted", "tag": "0b3aafd5-72f6-4c1b-860e-b16344f56933"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:21.815613 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-806057bb-2d34-4c23-8b33-1409172164b2 req-534d486b-7755-4c7d-bb34-f85e80cf1f10 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:21.816049 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-806057bb-2d34-4c23-8b33-1409172164b2 req-534d486b-7755-4c7d-bb34-f85e80cf1f10 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:21.828336 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-806057bb-2d34-4c23-8b33-1409172164b2 req-534d486b-7755-4c7d-bb34-f85e80cf1f10 service nova] Creating event network-vif-deleted:0b3aafd5-72f6-4c1b-860e-b16344f56933 for instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d on hv-cinder-84315 May 24 15:47:21.834185 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-806057bb-2d34-4c23-8b33-1409172164b2 req-534d486b-7755-4c7d-bb34-f85e80cf1f10 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032559 May 24 15:47:21.834906 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 492/935] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:22.550074 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e280a119-b06e-4b5c-9b4e-7ae197285cc6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:22.550619 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e280a119-b06e-4b5c-9b4e-7ae197285cc6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:22.558191 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e280a119-b06e-4b5c-9b4e-7ae197285cc6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:22.558637 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e280a119-b06e-4b5c-9b4e-7ae197285cc6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:22.559401 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e280a119-b06e-4b5c-9b4e-7ae197285cc6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:22.559831 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e280a119-b06e-4b5c-9b4e-7ae197285cc6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:22.574565 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-e280a119-b06e-4b5c-9b4e-7ae197285cc6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e280a119-b06e-4b5c-9b4e-7ae197285cc6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d HTTP/1.1 May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:47:22.576268 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:47:22.577995 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d'} May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:47:22.578917 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:47:22.580310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:22.581485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e280a119-b06e-4b5c-9b4e-7ae197285cc6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:47:22.581485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e280a119-b06e-4b5c-9b4e-7ae197285cc6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 404 len: 111 microversion: 2.1 time: 0.031905 May 24 15:47:22.581485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 444/936] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:22 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:47:22.587606 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4510ed2c-50e3-4ce9-a9d7-2a8317192bb1 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '.version_select at 0x7fb1d478f670>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:22.607686 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-4510ed2c-50e3-4ce9-a9d7-2a8317192bb1 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633668384" status: 202 len: 0 microversion: 2.1 time: 0.024277 May 24 15:47:22.608316 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 493/937] 10.222.0.55 () {58 vars in 1220 bytes} [Tue May 24 15:47:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633668384 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:47:23.243156 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-240431eb-5f78-41c4-bace-b8c029e621e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: .version_select at 0x7fb1d5289280>, body: {"keypair": {"name": "tempest-keypair-816735434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQKFq0Q3fVwlCXLIIXK/QeguHhL+1lS3HlqF5Y68GOtVxrcHjde0eh224EUs7UYvnEJeQYAzFpp017Lh8DXAog2kxqYKOmN9zSVMMp1+YDrGOv3jmeJ0xoMDnd/JfPMng=="}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:23.257205 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-240431eb-5f78-41c4-bace-b8c029e621e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for project a30edd891b96456fbba6409a815f5fd8. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:47:23.260982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-240431eb-5f78-41c4-bace-b8c029e621e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for user 0f8105d1de0d45218576d74a2ba4abe4 and project a30edd891b96456fbba6409a815f5fd8. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:47:23.288825 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-240431eb-5f78-41c4-bace-b8c029e621e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049587 May 24 15:47:23.289420 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 445/938] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 24 15:47:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:24.581892 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1837942898", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1eca94ca-2475-4c7a-b305-a2f26b6c82f9"}], "security_groups": [{"name": "tempest-securitygroup--1390748573"}], "key_name": "tempest-keypair-816735434", "user_data": "}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:24.691312 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] validate_networks() for [('1eca94ca-2475-4c7a-b305-a2f26b6c82f9', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:47:25.066964 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:47:25.067386 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:47:25.067848 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:47:25.068284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:47:25.068686 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:47:25.077843 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:25.078283 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:25.079090 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:25.079515 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:25.096281 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for project a30edd891b96456fbba6409a815f5fd8. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:47:25.100422 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for user 0f8105d1de0d45218576d74a2ba4abe4 and project a30edd891b96456fbba6409a815f5fd8. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:47:25.111601 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:47:25.114020 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:47:25.170075 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d5d11e56-4535-4590-b333-303cbdbb0f41 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.592617 May 24 15:47:25.171071 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 494/939] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:47:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:47:25.182702 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f471b8da-6242-428d-8f17-2d6fdd9f1aba tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:25.183401 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f471b8da-6242-428d-8f17-2d6fdd9f1aba tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:25.238749 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-f471b8da-6242-428d-8f17-2d6fdd9f1aba tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:25.246087 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f471b8da-6242-428d-8f17-2d6fdd9f1aba tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1241 microversion: 2.1 time: 0.068353 May 24 15:47:25.246629 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 446/940] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:25 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:26.263764 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-64178ad5-94fc-4add-b9c4-961958bea853 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:26.264427 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-64178ad5-94fc-4add-b9c4-961958bea853 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:26.272303 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-64178ad5-94fc-4add-b9c4-961958bea853 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:26.273316 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-64178ad5-94fc-4add-b9c4-961958bea853 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:26.273524 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-64178ad5-94fc-4add-b9c4-961958bea853 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:26.273944 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-64178ad5-94fc-4add-b9c4-961958bea853 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:26.344350 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-64178ad5-94fc-4add-b9c4-961958bea853 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:26.352627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-64178ad5-94fc-4add-b9c4-961958bea853 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1311 microversion: 2.1 time: 0.093310 May 24 15:47:26.353566 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 495/941] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:26 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:27.370530 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c7585778-fb36-4640-98df-f8ed5979ffca tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:27.371160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c7585778-fb36-4640-98df-f8ed5979ffca tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:27.377707 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c7585778-fb36-4640-98df-f8ed5979ffca tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:27.378149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c7585778-fb36-4640-98df-f8ed5979ffca tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:27.379131 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c7585778-fb36-4640-98df-f8ed5979ffca tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:27.379570 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c7585778-fb36-4640-98df-f8ed5979ffca tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:27.510156 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c7585778-fb36-4640-98df-f8ed5979ffca tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:27.518241 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c7585778-fb36-4640-98df-f8ed5979ffca tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1367 microversion: 2.1 time: 0.151674 May 24 15:47:27.519684 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 447/942] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:27 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:47:27.764728 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-e2ff3b11-0f4d-48f5-aeea-28258aae81e3 req-bed5fd40-2fe2-4e52-8ab4-36400080d605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a71ea75e-0ceb-452a-ae87-90e9793528ad", "tag": "411b5ef0-37e3-4d18-ae3b-36ebfae36cf2"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:27.777814 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-e2ff3b11-0f4d-48f5-aeea-28258aae81e3 req-bed5fd40-2fe2-4e52-8ab4-36400080d605 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:27.778501 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-e2ff3b11-0f4d-48f5-aeea-28258aae81e3 req-bed5fd40-2fe2-4e52-8ab4-36400080d605 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:27.794077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-e2ff3b11-0f4d-48f5-aeea-28258aae81e3 req-bed5fd40-2fe2-4e52-8ab4-36400080d605 service nova] Creating event network-changed:411b5ef0-37e3-4d18-ae3b-36ebfae36cf2 for instance a71ea75e-0ceb-452a-ae87-90e9793528ad on hv-cinder-84315 May 24 15:47:27.799056 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-e2ff3b11-0f4d-48f5-aeea-28258aae81e3 req-bed5fd40-2fe2-4e52-8ab4-36400080d605 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040730 May 24 15:47:27.799645 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 496/943] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:47:28.538598 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e2f658a6-2484-4ec0-b763-33d31f64b300 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:28.539188 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e2f658a6-2484-4ec0-b763-33d31f64b300 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:28.546782 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e2f658a6-2484-4ec0-b763-33d31f64b300 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:28.547271 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e2f658a6-2484-4ec0-b763-33d31f64b300 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:28.548137 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e2f658a6-2484-4ec0-b763-33d31f64b300 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:28.548618 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e2f658a6-2484-4ec0-b763-33d31f64b300 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:28.689834 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e2f658a6-2484-4ec0-b763-33d31f64b300 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:28.699081 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e2f658a6-2484-4ec0-b763-33d31f64b300 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1367 microversion: 2.1 time: 0.165487 May 24 15:47:28.699694 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 448/944] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:28 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:28.994534 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-37157f8b-b32d-471d-8894-a8fb5db38ef2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:28.995132 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-37157f8b-b32d-471d-8894-a8fb5db38ef2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:29.002609 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-37157f8b-b32d-471d-8894-a8fb5db38ef2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:29.003075 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-37157f8b-b32d-471d-8894-a8fb5db38ef2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:29.003867 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-37157f8b-b32d-471d-8894-a8fb5db38ef2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:29.004359 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-37157f8b-b32d-471d-8894-a8fb5db38ef2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:29.028108 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-37157f8b-b32d-471d-8894-a8fb5db38ef2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/ips" status: 200 len: 145 microversion: 2.1 time: 0.038114 May 24 15:47:29.028693 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 497/945] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 24 15:47:28 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:29.716199 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-46abe877-c129-4d9c-b743-551643de81e5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:29.716810 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-46abe877-c129-4d9c-b743-551643de81e5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:29.723290 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-46abe877-c129-4d9c-b743-551643de81e5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:29.723737 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-46abe877-c129-4d9c-b743-551643de81e5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:29.724541 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-46abe877-c129-4d9c-b743-551643de81e5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:29.724976 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-46abe877-c129-4d9c-b743-551643de81e5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:29.864252 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-46abe877-c129-4d9c-b743-551643de81e5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:29.875604 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-46abe877-c129-4d9c-b743-551643de81e5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1367 microversion: 2.1 time: 0.163070 May 24 15:47:29.876399 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 449/946] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:29 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:30.368368 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cc8d9594-34d8-4c47-90db-2371e69c27de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6473a90c-e4d1-4ba1-8cc5-77df5365750e"}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:30.369449 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-cc8d9594-34d8-4c47-90db-2371e69c27de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:30.376289 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cc8d9594-34d8-4c47-90db-2371e69c27de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:30.376728 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cc8d9594-34d8-4c47-90db-2371e69c27de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:30.377479 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cc8d9594-34d8-4c47-90db-2371e69c27de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:30.377901 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cc8d9594-34d8-4c47-90db-2371e69c27de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:30.671913 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cc8d9594-34d8-4c47-90db-2371e69c27de tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307620 May 24 15:47:30.672654 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 498/947] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:47:30 2022] POST /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:30.893484 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e1bb6331-6dfa-4a07-a637-f6a05d30f48a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:30.894058 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e1bb6331-6dfa-4a07-a637-f6a05d30f48a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:30.901101 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1bb6331-6dfa-4a07-a637-f6a05d30f48a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:30.901545 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1bb6331-6dfa-4a07-a637-f6a05d30f48a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:30.902320 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1bb6331-6dfa-4a07-a637-f6a05d30f48a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:30.902716 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e1bb6331-6dfa-4a07-a637-f6a05d30f48a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:31.036531 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e1bb6331-6dfa-4a07-a637-f6a05d30f48a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:31.044454 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e1bb6331-6dfa-4a07-a637-f6a05d30f48a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1367 microversion: 2.1 time: 0.154783 May 24 15:47:31.045032 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 450/948] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:30 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:32.065419 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ab1f12e3-e10a-4903-96f1-0cd9648c6fd5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:32.066509 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ab1f12e3-e10a-4903-96f1-0cd9648c6fd5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:32.074388 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ab1f12e3-e10a-4903-96f1-0cd9648c6fd5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:32.074830 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ab1f12e3-e10a-4903-96f1-0cd9648c6fd5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:32.075582 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ab1f12e3-e10a-4903-96f1-0cd9648c6fd5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:32.076009 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ab1f12e3-e10a-4903-96f1-0cd9648c6fd5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:32.235160 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ab1f12e3-e10a-4903-96f1-0cd9648c6fd5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:32.244981 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ab1f12e3-e10a-4903-96f1-0cd9648c6fd5 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1367 microversion: 2.1 time: 0.186130 May 24 15:47:32.245834 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 499/949] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:32 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:33.230439 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-a648b8e9-14e4-4a37-87f4-517ac2f19cfd req-a3ce58d6-ed4a-468c-8a1d-48b0ef7ee493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a71ea75e-0ceb-452a-ae87-90e9793528ad", "name": "network-vif-plugged", "status": "completed", "tag": "411b5ef0-37e3-4d18-ae3b-36ebfae36cf2"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:33.241189 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-a648b8e9-14e4-4a37-87f4-517ac2f19cfd req-a3ce58d6-ed4a-468c-8a1d-48b0ef7ee493 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:33.241705 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-a648b8e9-14e4-4a37-87f4-517ac2f19cfd req-a3ce58d6-ed4a-468c-8a1d-48b0ef7ee493 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:33.253087 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-a648b8e9-14e4-4a37-87f4-517ac2f19cfd req-a3ce58d6-ed4a-468c-8a1d-48b0ef7ee493 service nova] Creating event network-vif-plugged:411b5ef0-37e3-4d18-ae3b-36ebfae36cf2 for instance a71ea75e-0ceb-452a-ae87-90e9793528ad on hv-cinder-84315 May 24 15:47:33.258388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-a648b8e9-14e4-4a37-87f4-517ac2f19cfd req-a3ce58d6-ed4a-468c-8a1d-48b0ef7ee493 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031602 May 24 15:47:33.260546 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 451/950] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:47:33.265984 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0bb7df84-0b15-4977-a126-0f38b4b3edaa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:33.266740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0bb7df84-0b15-4977-a126-0f38b4b3edaa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:33.273944 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0bb7df84-0b15-4977-a126-0f38b4b3edaa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:33.274396 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0bb7df84-0b15-4977-a126-0f38b4b3edaa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:33.275162 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0bb7df84-0b15-4977-a126-0f38b4b3edaa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:33.275600 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0bb7df84-0b15-4977-a126-0f38b4b3edaa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:33.410380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0bb7df84-0b15-4977-a126-0f38b4b3edaa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:33.418912 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0bb7df84-0b15-4977-a126-0f38b4b3edaa tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1367 microversion: 2.1 time: 0.157440 May 24 15:47:33.419486 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 500/951] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:33 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 15:47:34.439237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c31b12ab-1af7-4cd3-a2cd-29b08c1cbdd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:34.440170 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c31b12ab-1af7-4cd3-a2cd-29b08c1cbdd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:34.447675 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c31b12ab-1af7-4cd3-a2cd-29b08c1cbdd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:34.448174 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c31b12ab-1af7-4cd3-a2cd-29b08c1cbdd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:34.448955 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c31b12ab-1af7-4cd3-a2cd-29b08c1cbdd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:34.449387 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c31b12ab-1af7-4cd3-a2cd-29b08c1cbdd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:34.591330 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-c31b12ab-1af7-4cd3-a2cd-29b08c1cbdd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:34.599869 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c31b12ab-1af7-4cd3-a2cd-29b08c1cbdd6 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1367 microversion: 2.1 time: 0.166455 May 24 15:47:34.600501 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 452/952] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:34 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:35.617462 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cadf2769-17a5-4fc3-b6a8-3255f4abebf8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:35.618008 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-cadf2769-17a5-4fc3-b6a8-3255f4abebf8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:35.620533 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:35.621186 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=6 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:35.627395 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cadf2769-17a5-4fc3-b6a8-3255f4abebf8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:35.627819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cadf2769-17a5-4fc3-b6a8-3255f4abebf8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:35.628612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cadf2769-17a5-4fc3-b6a8-3255f4abebf8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:35.629047 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cadf2769-17a5-4fc3-b6a8-3255f4abebf8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:35.767964 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-cadf2769-17a5-4fc3-b6a8-3255f4abebf8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:35.771765 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:35.776373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cadf2769-17a5-4fc3-b6a8-3255f4abebf8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1557 microversion: 2.1 time: 0.163091 May 24 15:47:35.776936 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 501/953] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:35 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:35.792765 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c1344ae1-2076-4090-960b-b505e411cce4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:35.793310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c1344ae1-2076-4090-960b-b505e411cce4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:35.795233 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=6 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:35.801111 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c1344ae1-2076-4090-960b-b505e411cce4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:35.801553 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c1344ae1-2076-4090-960b-b505e411cce4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:35.802406 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c1344ae1-2076-4090-960b-b505e411cce4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:35.802837 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c1344ae1-2076-4090-960b-b505e411cce4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:35.884968 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c1344ae1-2076-4090-960b-b505e411cce4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096149 May 24 15:47:35.885534 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 453/954] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 24 15:47:35 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:37.105456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-71e1f4ce-ae05-41a6-b933-be901fc62d49 req-8a5806d6-4cbd-43d5-a028-b489030aef4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a71ea75e-0ceb-452a-ae87-90e9793528ad", "tag": "411b5ef0-37e3-4d18-ae3b-36ebfae36cf2"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:37.114406 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-71e1f4ce-ae05-41a6-b933-be901fc62d49 req-8a5806d6-4cbd-43d5-a028-b489030aef4f service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:37.115025 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-71e1f4ce-ae05-41a6-b933-be901fc62d49 req-8a5806d6-4cbd-43d5-a028-b489030aef4f service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:37.127134 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-71e1f4ce-ae05-41a6-b933-be901fc62d49 req-8a5806d6-4cbd-43d5-a028-b489030aef4f service nova] Creating event network-changed:411b5ef0-37e3-4d18-ae3b-36ebfae36cf2 for instance a71ea75e-0ceb-452a-ae87-90e9793528ad on hv-cinder-84315 May 24 15:47:37.132050 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-71e1f4ce-ae05-41a6-b933-be901fc62d49 req-8a5806d6-4cbd-43d5-a028-b489030aef4f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030858 May 24 15:47:37.132634 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 502/955] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:38.209296 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a9241ef5-7406-4667-8317-bf33428dc2cf tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:38.210210 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a9241ef5-7406-4667-8317-bf33428dc2cf tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:38.216486 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9241ef5-7406-4667-8317-bf33428dc2cf tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:38.216920 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9241ef5-7406-4667-8317-bf33428dc2cf tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:38.217670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9241ef5-7406-4667-8317-bf33428dc2cf tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:38.218090 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9241ef5-7406-4667-8317-bf33428dc2cf tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:38.234734 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:38.250220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a9241ef5-7406-4667-8317-bf33428dc2cf tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 May 24 15:47:38.250784 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 454/956] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:47:38 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:38.261908 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-844cdb21-ab04-4362-8393-18dae9808686 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:38.262830 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-844cdb21-ab04-4362-8393-18dae9808686 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:38.269396 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-844cdb21-ab04-4362-8393-18dae9808686 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:38.269777 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-844cdb21-ab04-4362-8393-18dae9808686 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:38.270530 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-844cdb21-ab04-4362-8393-18dae9808686 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:38.270976 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-844cdb21-ab04-4362-8393-18dae9808686 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:38.302507 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-844cdb21-ab04-4362-8393-18dae9808686 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments/6473a90c-e4d1-4ba1-8cc5-77df5365750e" status: 200 len: 194 microversion: 2.1 time: 0.045358 May 24 15:47:38.303103 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 503/957] 10.222.0.55 () {58 vars in 1412 bytes} [Tue May 24 15:47:38 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments/6473a90c-e4d1-4ba1-8cc5-77df5365750e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:39.629302 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-39abf05c-e33a-4e7f-877d-4aa617aa7eca tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb7814e9-18b5-46ce-a135-fe16523c6ddf"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:39.630467 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-39abf05c-e33a-4e7f-877d-4aa617aa7eca tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:39.637303 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-39abf05c-e33a-4e7f-877d-4aa617aa7eca tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:39.638068 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-39abf05c-e33a-4e7f-877d-4aa617aa7eca tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:39.638827 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-39abf05c-e33a-4e7f-877d-4aa617aa7eca tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:39.639257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-39abf05c-e33a-4e7f-877d-4aa617aa7eca tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:39.921794 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-39abf05c-e33a-4e7f-877d-4aa617aa7eca tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "POST /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296319 May 24 15:47:39.922407 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 455/958] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:47:39 2022] POST /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:47.482380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ba31c1a0-3841-407d-a9fb-6b76f2ecb16d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:47.483300 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ba31c1a0-3841-407d-a9fb-6b76f2ecb16d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:47.485988 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:47.491968 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ba31c1a0-3841-407d-a9fb-6b76f2ecb16d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:47.492300 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ba31c1a0-3841-407d-a9fb-6b76f2ecb16d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:47.493098 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ba31c1a0-3841-407d-a9fb-6b76f2ecb16d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:47.493530 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ba31c1a0-3841-407d-a9fb-6b76f2ecb16d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:47.532462 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ba31c1a0-3841-407d-a9fb-6b76f2ecb16d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053905 May 24 15:47:47.533061 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 504/959] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:47:47 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:47.683438 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f94fc0b1-e118-4eb8-b5f3-795bbc50218f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:47.683988 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-f94fc0b1-e118-4eb8-b5f3-795bbc50218f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:47.685862 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:47:47.691587 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f94fc0b1-e118-4eb8-b5f3-795bbc50218f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:47.692062 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f94fc0b1-e118-4eb8-b5f3-795bbc50218f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:47.692860 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f94fc0b1-e118-4eb8-b5f3-795bbc50218f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:47.693287 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-f94fc0b1-e118-4eb8-b5f3-795bbc50218f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:47.723214 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f94fc0b1-e118-4eb8-b5f3-795bbc50218f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments/6473a90c-e4d1-4ba1-8cc5-77df5365750e" status: 200 len: 194 microversion: 2.1 time: 0.045800 May 24 15:47:47.723800 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 456/960] 10.222.0.55 () {58 vars in 1412 bytes} [Tue May 24 15:47:47 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments/6473a90c-e4d1-4ba1-8cc5-77df5365750e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:47.733958 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2a85db3d-cc4c-4468-9f0b-e4ae1f93bf4a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:47.734450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2a85db3d-cc4c-4468-9f0b-e4ae1f93bf4a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:47.740568 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2a85db3d-cc4c-4468-9f0b-e4ae1f93bf4a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:47.741011 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2a85db3d-cc4c-4468-9f0b-e4ae1f93bf4a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:47.741852 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2a85db3d-cc4c-4468-9f0b-e4ae1f93bf4a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:47.742286 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2a85db3d-cc4c-4468-9f0b-e4ae1f93bf4a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:47.839756 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-2a85db3d-cc4c-4468-9f0b-e4ae1f93bf4a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lazy-loading 'services' on Instance uuid a8bae040-4604-4b06-ac56-e79ff91c5b44 {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:47:47.919607 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2a85db3d-cc4c-4468-9f0b-e4ae1f93bf4a tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments/6473a90c-e4d1-4ba1-8cc5-77df5365750e" status: 202 len: 0 microversion: 2.1 time: 0.189645 May 24 15:47:47.920397 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 505/961] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:47:47 2022] DELETE /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments/6473a90c-e4d1-4ba1-8cc5-77df5365750e => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:47:50.107308 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ca3b6eba-d587-409d-bba5-a575ef9c8845 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:50.107872 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ca3b6eba-d587-409d-bba5-a575ef9c8845 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:50.114674 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ca3b6eba-d587-409d-bba5-a575ef9c8845 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:50.115105 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ca3b6eba-d587-409d-bba5-a575ef9c8845 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:50.115875 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ca3b6eba-d587-409d-bba5-a575ef9c8845 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:50.116416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ca3b6eba-d587-409d-bba5-a575ef9c8845 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:50.145476 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ca3b6eba-d587-409d-bba5-a575ef9c8845 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments/cb7814e9-18b5-46ce-a135-fe16523c6ddf" status: 200 len: 194 microversion: 2.1 time: 0.042139 May 24 15:47:50.146060 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 457/962] 10.222.0.55 () {58 vars in 1412 bytes} [Tue May 24 15:47:50 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments/cb7814e9-18b5-46ce-a135-fe16523c6ddf => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:50.160816 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-8d7fb826-2322-4c74-9013-8cae45d145d2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:50.161391 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-8d7fb826-2322-4c74-9013-8cae45d145d2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:50.169568 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8d7fb826-2322-4c74-9013-8cae45d145d2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:50.170016 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8d7fb826-2322-4c74-9013-8cae45d145d2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:50.170784 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8d7fb826-2322-4c74-9013-8cae45d145d2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:50.171219 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-8d7fb826-2322-4c74-9013-8cae45d145d2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:50.254994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-8d7fb826-2322-4c74-9013-8cae45d145d2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lazy-loading 'services' on Instance uuid a8bae040-4604-4b06-ac56-e79ff91c5b44 {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:47:50.334017 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-8d7fb826-2322-4c74-9013-8cae45d145d2 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments/cb7814e9-18b5-46ce-a135-fe16523c6ddf" status: 202 len: 0 microversion: 2.1 time: 0.180890 May 24 15:47:50.334598 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 506/963] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:47:50 2022] DELETE /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments/cb7814e9-18b5-46ce-a135-fe16523c6ddf => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:47:51.500581 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-cdd03962-a331-426a-bcf4-8763f0651bfc tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:51.501563 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-cdd03962-a331-426a-bcf4-8763f0651bfc tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:51.508358 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cdd03962-a331-426a-bcf4-8763f0651bfc tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:51.508803 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cdd03962-a331-426a-bcf4-8763f0651bfc tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:51.509559 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cdd03962-a331-426a-bcf4-8763f0651bfc tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:51.509992 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cdd03962-a331-426a-bcf4-8763f0651bfc tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:51.548104 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-cdd03962-a331-426a-bcf4-8763f0651bfc tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051407 May 24 15:47:51.548653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 458/964] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:47:51 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:47:51.667288 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3247ea37-3613-43b6-b63d-aae44f17a9f0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:51.668380 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3247ea37-3613-43b6-b63d-aae44f17a9f0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:51.675024 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3247ea37-3613-43b6-b63d-aae44f17a9f0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:51.675456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3247ea37-3613-43b6-b63d-aae44f17a9f0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:51.676255 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3247ea37-3613-43b6-b63d-aae44f17a9f0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:51.676654 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3247ea37-3613-43b6-b63d-aae44f17a9f0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:51.706176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3247ea37-3613-43b6-b63d-aae44f17a9f0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043660 May 24 15:47:51.706724 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 507/965] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:47:51 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:47:51.769029 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-d3cdcfff-e33e-4832-8fd6-f29c5c53c570 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:51.769529 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d3cdcfff-e33e-4832-8fd6-f29c5c53c570 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:51.776122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d3cdcfff-e33e-4832-8fd6-f29c5c53c570 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:51.776562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d3cdcfff-e33e-4832-8fd6-f29c5c53c570 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:51.777316 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d3cdcfff-e33e-4832-8fd6-f29c5c53c570 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:51.777753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-d3cdcfff-e33e-4832-8fd6-f29c5c53c570 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:51.802400 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-d3cdcfff-e33e-4832-8fd6-f29c5c53c570 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:47:51.900046 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-d3cdcfff-e33e-4832-8fd6-f29c5c53c570 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 204 len: 0 microversion: 2.1 time: 0.133986 May 24 15:47:51.900676 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 459/966] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:47:51 2022] DELETE /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:47:51.908983 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a11ea716-e9a8-406a-87ab-d87ae1e977fd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:51.909612 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a11ea716-e9a8-406a-87ab-d87ae1e977fd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:51.916391 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a11ea716-e9a8-406a-87ab-d87ae1e977fd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:51.916840 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a11ea716-e9a8-406a-87ab-d87ae1e977fd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:51.917606 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a11ea716-e9a8-406a-87ab-d87ae1e977fd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:51.918033 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a11ea716-e9a8-406a-87ab-d87ae1e977fd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:52.080248 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a11ea716-e9a8-406a-87ab-d87ae1e977fd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:52.088404 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a11ea716-e9a8-406a-87ab-d87ae1e977fd tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1672 microversion: 2.1 time: 0.183292 May 24 15:47:52.088970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 508/967] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:51 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:53.110872 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4225bd9c-de0c-4d22-923f-752bd6a72e0b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:53.112014 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4225bd9c-de0c-4d22-923f-752bd6a72e0b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:53.122784 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4225bd9c-de0c-4d22-923f-752bd6a72e0b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:53.123522 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4225bd9c-de0c-4d22-923f-752bd6a72e0b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:53.124818 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4225bd9c-de0c-4d22-923f-752bd6a72e0b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:53.125513 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4225bd9c-de0c-4d22-923f-752bd6a72e0b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:53.270698 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4225bd9c-de0c-4d22-923f-752bd6a72e0b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:53.282694 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4225bd9c-de0c-4d22-923f-752bd6a72e0b tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1672 microversion: 2.1 time: 0.178571 May 24 15:47:53.283490 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 460/968] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:53 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:54.300560 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-e262afd5-1553-40ba-a958-9208a6a1e86f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:54.301299 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-e262afd5-1553-40ba-a958-9208a6a1e86f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:54.309616 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e262afd5-1553-40ba-a958-9208a6a1e86f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:54.310058 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e262afd5-1553-40ba-a958-9208a6a1e86f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:54.310926 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e262afd5-1553-40ba-a958-9208a6a1e86f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:54.311346 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-e262afd5-1553-40ba-a958-9208a6a1e86f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:54.374473 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-e262afd5-1553-40ba-a958-9208a6a1e86f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:54.384192 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-e262afd5-1553-40ba-a958-9208a6a1e86f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1605 microversion: 2.1 time: 0.087454 May 24 15:47:54.391466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 509/969] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:54 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:54.916976 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-b925448c-c315-49f9-8752-8682ab5af7f7 req-181a8614-d24e-41d5-8e96-8b30a14a2707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bae040-4604-4b06-ac56-e79ff91c5b44", "name": "network-vif-deleted", "tag": "45ec7467-59d5-4ea2-94ad-078af0dc4ea3"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:47:54.926670 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-b925448c-c315-49f9-8752-8682ab5af7f7 req-181a8614-d24e-41d5-8e96-8b30a14a2707 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:54.927203 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-b925448c-c315-49f9-8752-8682ab5af7f7 req-181a8614-d24e-41d5-8e96-8b30a14a2707 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:54.939065 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-b925448c-c315-49f9-8752-8682ab5af7f7 req-181a8614-d24e-41d5-8e96-8b30a14a2707 service nova] Creating event network-vif-deleted:45ec7467-59d5-4ea2-94ad-078af0dc4ea3 for instance a8bae040-4604-4b06-ac56-e79ff91c5b44 on hv-cinder-84315 May 24 15:47:54.945166 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-b925448c-c315-49f9-8752-8682ab5af7f7 req-181a8614-d24e-41d5-8e96-8b30a14a2707 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031250 May 24 15:47:54.945860 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 461/970] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:47:55.402518 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:55.403168 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:55.409433 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:55.410105 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:55.411647 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:55.412106 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:55.446814 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:55.447226 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:55.447939 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.objects.instance [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lazy-loading 'fault' on Instance uuid a8bae040-4604-4b06-ac56-e79ff91c5b44 {{(pid=129340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:47:55.494899 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8f617cb0b14532b3ad514a0430e54f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92c7d44a8de4b2ab85ab081276300fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:47:55.502406 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2933512b-1046-4317-a23e-bf5772ad969f tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 200 len: 1327 microversion: 2.1 time: 0.103908 May 24 15:47:55.502973 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 510/971] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:55 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:47:56.524582 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-13032677-d129-4933-a8f5-99a9d661f40e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:56.525361 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-13032677-d129-4933-a8f5-99a9d661f40e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:56.532838 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13032677-d129-4933-a8f5-99a9d661f40e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:56.533334 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13032677-d129-4933-a8f5-99a9d661f40e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:56.534176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13032677-d129-4933-a8f5-99a9d661f40e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:56.534659 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-13032677-d129-4933-a8f5-99a9d661f40e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:56.549537 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-13032677-d129-4933-a8f5-99a9d661f40e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] HTTP exception thrown: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-13032677-d129-4933-a8f5-99a9d661f40e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Request method failure captured: May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 HTTP/1.1 May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP0w4kcR4gjDWL0Rds7DQldrzW0uzA0JQrwOzP-El9r744pCpcfy_8uv1RHZ3XcTKs8V5L4_1g43rtXzrYFuWQosDI22wgr-AwtFcsW51BgZDMdb64Pr0DOmpNHXSn7hIAEzvIDoC7RpHTd8au5UJD6epo32tqLh_TCuWv9wgL0r2oo May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:47:56.551319 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeTestJSON-1944954544 May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: ad8f617cb0b14532b3ad514a0430e54f May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:56.553022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'a8bae040-4604-4b06-ac56-e79ff91c5b44'} May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:47:56.554008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:56.555623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:56.557503 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-13032677-d129-4933-a8f5-99a9d661f40e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Returning 404 to user: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:47:56.557503 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-13032677-d129-4933-a8f5-99a9d661f40e tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 404 len: 111 microversion: 2.1 time: 0.035305 May 24 15:47:56.557503 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 462/972] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:56 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:47:56.562719 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-87a42642-5bf1-4e1c-b91f-141656cbdde9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '.version_select at 0x7fb1d49298b0>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:56.581955 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-87a42642-5bf1-4e1c-b91f-141656cbdde9 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332295060" status: 202 len: 0 microversion: 2.1 time: 0.022955 May 24 15:47:56.582643 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 511/973] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 24 15:47:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332295060 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:47:59.489239 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ec7a92a7-83f5-41da-b60b-e82bd7d44400 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:59.489757 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-ec7a92a7-83f5-41da-b60b-e82bd7d44400 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:59.497066 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ec7a92a7-83f5-41da-b60b-e82bd7d44400 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:59.497580 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ec7a92a7-83f5-41da-b60b-e82bd7d44400 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:59.498344 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ec7a92a7-83f5-41da-b60b-e82bd7d44400 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:59.498783 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-ec7a92a7-83f5-41da-b60b-e82bd7d44400 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:59.513375 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-ec7a92a7-83f5-41da-b60b-e82bd7d44400 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] HTTP exception thrown: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ec7a92a7-83f5-41da-b60b-e82bd7d44400 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Request method failure captured: May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: DELETE /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 HTTP/1.1 May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP0w4kcR4gjDWL0Rds7DQldrzW0uzA0JQrwOzP-El9r744pCpcfy_8uv1RHZ3XcTKs8V5L4_1g43rtXzrYFuWQosDI22wgr-AwtFcsW51BgZDMdb64Pr0DOmpNHXSn7hIAEzvIDoC7RpHTd8au5UJD6epo32tqLh_TCuWv9wgL0r2oo May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:47:59.514916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeTestJSON-1944954544 May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: ad8f617cb0b14532b3ad514a0430e54f May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:59.516434 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'a8bae040-4604-4b06-ac56-e79ff91c5b44'} May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:47:59.517253 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:59.518823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:47:59.520765 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-ec7a92a7-83f5-41da-b60b-e82bd7d44400 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Returning 404 to user: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:47:59.520765 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-ec7a92a7-83f5-41da-b60b-e82bd7d44400 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 404 len: 111 microversion: 2.1 time: 0.031011 May 24 15:47:59.520765 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 463/974] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:47:59 2022] DELETE /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:47:59.525638 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-de1177f7-e7e8-45fa-a91e-4dbc207a008d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:47:59.526245 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-de1177f7-e7e8-45fa-a91e-4dbc207a008d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: a8bae040-4604-4b06-ac56-e79ff91c5b44] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:47:59.532475 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-de1177f7-e7e8-45fa-a91e-4dbc207a008d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:59.532919 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-de1177f7-e7e8-45fa-a91e-4dbc207a008d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:59.533671 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-de1177f7-e7e8-45fa-a91e-4dbc207a008d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:47:59.534103 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-de1177f7-e7e8-45fa-a91e-4dbc207a008d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:47:59.547368 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-de1177f7-e7e8-45fa-a91e-4dbc207a008d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] HTTP exception thrown: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-de1177f7-e7e8-45fa-a91e-4dbc207a008d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Request method failure captured: May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 HTTP/1.1 May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP0w4kcR4gjDWL0Rds7DQldrzW0uzA0JQrwOzP-El9r744pCpcfy_8uv1RHZ3XcTKs8V5L4_1g43rtXzrYFuWQosDI22wgr-AwtFcsW51BgZDMdb64Pr0DOmpNHXSn7hIAEzvIDoC7RpHTd8au5UJD6epo32tqLh_TCuWv9wgL0r2oo May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:47:59.549032 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeTestJSON-1944954544 May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: ad8f617cb0b14532b3ad514a0430e54f May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:59.550639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'a8bae040-4604-4b06-ac56-e79ff91c5b44'} May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:47:59.551766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. May 24 15:47:59.553377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:47:59.554872 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-de1177f7-e7e8-45fa-a91e-4dbc207a008d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Returning 404 to user: Instance a8bae040-4604-4b06-ac56-e79ff91c5b44 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:47:59.554872 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-de1177f7-e7e8-45fa-a91e-4dbc207a008d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44" status: 404 len: 111 microversion: 2.1 time: 0.029372 May 24 15:47:59.554872 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 512/975] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:47:59 2022] GET /compute/v2.1/servers/a8bae040-4604-4b06-ac56-e79ff91c5b44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:48:00.713115 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7d16e6a4-e3e4-4f21-9d68-2dbe9e63df9d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:00.713619 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7d16e6a4-e3e4-4f21-9d68-2dbe9e63df9d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:00.721035 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7d16e6a4-e3e4-4f21-9d68-2dbe9e63df9d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:00.721479 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7d16e6a4-e3e4-4f21-9d68-2dbe9e63df9d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:00.722237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7d16e6a4-e3e4-4f21-9d68-2dbe9e63df9d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:00.722668 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7d16e6a4-e3e4-4f21-9d68-2dbe9e63df9d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:00.737303 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-7d16e6a4-e3e4-4f21-9d68-2dbe9e63df9d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] HTTP exception thrown: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7d16e6a4-e3e4-4f21-9d68-2dbe9e63df9d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Request method failure captured: May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: DELETE /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 HTTP/1.1 May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP0w4kcR4gjDWL0Rds7DQldrzW0uzA0JQrwOzP-El9r744pCpcfy_8uv1RHZ3XcTKs8V5L4_1g43rtXzrYFuWQosDI22wgr-AwtFcsW51BgZDMdb64Pr0DOmpNHXSn7hIAEzvIDoC7RpHTd8au5UJD6epo32tqLh_TCuWv9wgL0r2oo May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:48:00.738816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeTestJSON-1944954544 May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: ad8f617cb0b14532b3ad514a0430e54f May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:48:00.740552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': '307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38'} May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:48:00.741417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:48:00.742944 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:00.744542 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7d16e6a4-e3e4-4f21-9d68-2dbe9e63df9d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Returning 404 to user: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:48:00.744542 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7d16e6a4-e3e4-4f21-9d68-2dbe9e63df9d tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "DELETE /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 404 len: 111 microversion: 2.1 time: 0.031066 May 24 15:48:00.744542 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 464/976] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:48:00 2022] DELETE /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:48:00.750854 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-516aaef9-1d97-4012-a014-94ac612e48c0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:00.751544 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-516aaef9-1d97-4012-a014-94ac612e48c0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] [instance: 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:00.761363 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-516aaef9-1d97-4012-a014-94ac612e48c0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:00.761855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-516aaef9-1d97-4012-a014-94ac612e48c0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:00.762939 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-516aaef9-1d97-4012-a014-94ac612e48c0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:00.763377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-516aaef9-1d97-4012-a014-94ac612e48c0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:00.777607 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-516aaef9-1d97-4012-a014-94ac612e48c0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] HTTP exception thrown: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-516aaef9-1d97-4012-a014-94ac612e48c0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Request method failure captured: May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 HTTP/1.1 May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP0w4kcR4gjDWL0Rds7DQldrzW0uzA0JQrwOzP-El9r744pCpcfy_8uv1RHZ3XcTKs8V5L4_1g43rtXzrYFuWQosDI22wgr-AwtFcsW51BgZDMdb64Pr0DOmpNHXSn7hIAEzvIDoC7RpHTd8au5UJD6epo32tqLh_TCuWv9wgL0r2oo May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:48:00.779265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f92c7d44a8de4b2ab85ab081276300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeTestJSON-1944954544 May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: f92c7d44a8de4b2ab85ab081276300fd May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1944954544 May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: ad8f617cb0b14532b3ad514a0430e54f May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeTestJSON-1944954544-project May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:48:00.781077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38'} May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:48:00.785354 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. May 24 15:48:00.787308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:00.788745 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-516aaef9-1d97-4012-a014-94ac612e48c0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] Returning 404 to user: Instance 307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:48:00.788745 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-516aaef9-1d97-4012-a014-94ac612e48c0 tempest-AttachVolumeTestJSON-1944954544 tempest-AttachVolumeTestJSON-1944954544-project] 10.222.0.55 "GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38" status: 404 len: 111 microversion: 2.1 time: 0.035928 May 24 15:48:00.788745 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 513/977] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:00 2022] GET /compute/v2.1/servers/307c4d42-5da6-4fc8-b1f8-a7f59a1d5c38 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:48:05.205780 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5c67130c-aa0a-4d22-b06f-483dbeefe865 tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] Action: 'create', calling method: .version_select at 0x7fb1d5145820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1480523289", "metadata": {"Type": "work"}}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:05.600946 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5c67130c-aa0a-4d22-b06f-483dbeefe865 tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.509960 May 24 15:48:05.601782 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 465/978] 10.222.0.55 () {60 vars in 1155 bytes} [Tue May 24 15:48:05 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 511 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 15:48:05.613932 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-71dae893-cd30-43dd-8e32-0ee5ba002afd tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] Calling method '.version_select at 0x7fb1d4b630d0>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:05.663497 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-71dae893-cd30-43dd-8e32-0ee5ba002afd tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13" status: 200 len: 353 microversion: 2.1 time: 0.053310 May 24 15:48:05.664239 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 514/979] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:48:05 2022] GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:48:06.681020 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9c31d495-e55f-4e86-b70a-68451ac6d997 tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] Calling method '.version_select at 0x7fb1d533dc10>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:06.739572 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9c31d495-e55f-4e86-b70a-68451ac6d997 tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13" status: 200 len: 354 microversion: 2.1 time: 0.065820 May 24 15:48:06.740161 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 466/980] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:48:06 2022] GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:06.751507 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-63606e16-3038-4146-9829-0985b69ca189 tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] Calling method '.version_select at 0x7fb1d4929280>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:06.861377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-63606e16-3038-4146-9829-0985b69ca189 tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13" status: 200 len: 354 microversion: 2.1 time: 0.113657 May 24 15:48:06.862078 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 515/981] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:48:06 2022] GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:06.878262 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-05d4ee7b-f5e0-4f22-b4e8-b9d9438793f7 tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] Calling method '.version_select at 0x7fb1d51cff70>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:06.944902 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-05d4ee7b-f5e0-4f22-b4e8-b9d9438793f7 tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13" status: 202 len: 0 microversion: 2.1 time: 0.070569 May 24 15:48:06.945774 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 467/982] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 24 15:48:06 2022] DELETE /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:48:06.954388 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-feb958f7-3ba1-4c0a-8b69-604fe7d04fb7 tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] Calling method '.version_select at 0x7fb1d472aa60>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:07.002486 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-feb958f7-3ba1-4c0a-8b69-604fe7d04fb7 tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13" status: 200 len: 353 microversion: 2.1 time: 0.052025 May 24 15:48:07.003085 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 516/983] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:48:06 2022] GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:08.020773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f9b84b52-fdc9-4544-a534-454e3add8fee tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] Calling method '.version_select at 0x7fb1d53bdaf0>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:08.060662 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-f9b84b52-fdc9-4544-a534-454e3add8fee tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] HTTP exception thrown: Volume d4cc13ba-fa93-4067-8c1d-20165714bc13 could not be found. May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f9b84b52-fdc9-4544-a534-454e3add8fee tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] Request method failure captured: May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13 HTTP/1.1 May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP41u0efFHCDxkrhLZWjRNDYUZ_lT7mvmHAs9ZGb5lYRdVqJfV6bMcfZQWn263Qg9ZCFPPWHryVp1k3Aoiczeg8oxhzHEHrqAV0onh5_HEw1aata5qibcrlIumjwDyUXUqJDkkSUU9_xSeOwPEPCIGwmiF0x32Eoxli0MYUPzHhzUsA May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: 6a1471fc4fa54e2f9b013123308d0607 May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-VolumesGetTestJSON-193575528 May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:48:08.063867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6a1471fc4fa54e2f9b013123308d0607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6a1471fc4fa54e2f9b013123308d0607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6a1471fc4fa54e2f9b013123308d0607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6a1471fc4fa54e2f9b013123308d0607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-VolumesGetTestJSON-193575528 May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: 6a1471fc4fa54e2f9b013123308d0607 May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-VolumesGetTestJSON-193575528 May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-VolumesGetTestJSON-193575528-project May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 9b5e098139dc497785c17c0c764d8ab2 May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-VolumesGetTestJSON-193575528-project May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Volume d4cc13ba-fa93-4067-8c1d-20165714bc13 could not be found. May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'd4cc13ba-fa93-4067-8c1d-20165714bc13'} May 24 15:48:08.065550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d4cc13ba-fa93-4067-8c1d-20165714bc13 could not be found. (HTTP 404) (Request-ID: req-c1f20ad8-9890-4c4d-a586-80439e1896fe) May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:08.066599 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 15:48:08.067925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d4cc13ba-fa93-4067-8c1d-20165714bc13 could not be found. May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 15:48:08.069144 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d4cc13ba-fa93-4067-8c1d-20165714bc13 could not be found. May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d4cc13ba-fa93-4067-8c1d-20165714bc13 could not be found. May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-f9b84b52-fdc9-4544-a534-454e3add8fee tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] Returning 404 to user: Volume d4cc13ba-fa93-4067-8c1d-20165714bc13 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-f9b84b52-fdc9-4544-a534-454e3add8fee tempest-VolumesGetTestJSON-193575528 tempest-VolumesGetTestJSON-193575528-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13" status: 404 len: 109 microversion: 2.1 time: 0.051929 May 24 15:48:08.070331 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 468/984] 10.222.0.55 () {58 vars in 1244 bytes} [Tue May 24 15:48:08 2022] GET /compute/v2.1/os-volumes/d4cc13ba-fa93-4067-8c1d-20165714bc13 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:48:13.425171 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:13.425926 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:13.430394 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-382c5416-79f3-424d-a749-a221a5467e58 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:13.431117 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-382c5416-79f3-424d-a749-a221a5467e58 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:13.440548 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-382c5416-79f3-424d-a749-a221a5467e58 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:13.441257 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-382c5416-79f3-424d-a749-a221a5467e58 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:13.442134 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-382c5416-79f3-424d-a749-a221a5467e58 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:13.442601 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-382c5416-79f3-424d-a749-a221a5467e58 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:13.468457 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-382c5416-79f3-424d-a749-a221a5467e58 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/ips" status: 200 len: 149 microversion: 2.1 time: 0.044810 May 24 15:48:13.469027 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 517/985] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 24 15:48:13 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:14.806990 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:14.807744 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:14.822469 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-96a7f8ab-44dc-4f0e-bf6d-74dd1a0edd7c tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "250f6715-5945-4977-9d9c-ec3bc1a0bf97"}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:14.823562 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-96a7f8ab-44dc-4f0e-bf6d-74dd1a0edd7c tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:14.831447 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-96a7f8ab-44dc-4f0e-bf6d-74dd1a0edd7c tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:14.832081 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-96a7f8ab-44dc-4f0e-bf6d-74dd1a0edd7c tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:14.832867 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-96a7f8ab-44dc-4f0e-bf6d-74dd1a0edd7c tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:14.833301 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-96a7f8ab-44dc-4f0e-bf6d-74dd1a0edd7c tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:15.098650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-96a7f8ab-44dc-4f0e-bf6d-74dd1a0edd7c tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293612 May 24 15:48:15.099259 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 469/986] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:48:14 2022] POST /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:48:15.231962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3fa39082-970a-4367-83a6-c4e06468cc5b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:15.238552 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-458a91f5-72f8-44f4-a981-b2a0942c1da0 req-a8b800ce-f7cc-4161-9c7e-3a382e3d26e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f052d1b5-52db-4a7f-9455-19439d077d63", "tag": "32c2c21f-098c-426f-a69f-e6795e6db5ba"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:15.238903 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3fa39082-970a-4367-83a6-c4e06468cc5b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:15.250552 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3fa39082-970a-4367-83a6-c4e06468cc5b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:15.254879 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-458a91f5-72f8-44f4-a981-b2a0942c1da0 req-a8b800ce-f7cc-4161-9c7e-3a382e3d26e3 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:15.255355 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3fa39082-970a-4367-83a6-c4e06468cc5b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:15.256425 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3fa39082-970a-4367-83a6-c4e06468cc5b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:15.256862 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3fa39082-970a-4367-83a6-c4e06468cc5b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:15.259850 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-458a91f5-72f8-44f4-a981-b2a0942c1da0 req-a8b800ce-f7cc-4161-9c7e-3a382e3d26e3 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:15.282367 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-458a91f5-72f8-44f4-a981-b2a0942c1da0 req-a8b800ce-f7cc-4161-9c7e-3a382e3d26e3 service nova] Creating event network-changed:32c2c21f-098c-426f-a69f-e6795e6db5ba for instance f052d1b5-52db-4a7f-9455-19439d077d63 on hv-cinder-84315 May 24 15:48:15.288083 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-458a91f5-72f8-44f4-a981-b2a0942c1da0 req-a8b800ce-f7cc-4161-9c7e-3a382e3d26e3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053926 May 24 15:48:15.289287 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 470/987] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:15.303661 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3fa39082-970a-4367-83a6-c4e06468cc5b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Going to try to terminate instance {{(pid=129340) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:48:15.382192 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3fa39082-970a-4367-83a6-c4e06468cc5b tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 204 len: 0 microversion: 2.1 time: 0.153818 May 24 15:48:15.383046 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 518/988] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:48:15 2022] DELETE /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:48:15.393063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6eb5ff43-426b-4aff-889c-42f3e6fefeba tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:15.393757 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6eb5ff43-426b-4aff-889c-42f3e6fefeba tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:15.402182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6eb5ff43-426b-4aff-889c-42f3e6fefeba tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:15.402622 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6eb5ff43-426b-4aff-889c-42f3e6fefeba tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:15.403376 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6eb5ff43-426b-4aff-889c-42f3e6fefeba tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:15.403801 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6eb5ff43-426b-4aff-889c-42f3e6fefeba tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:15.555688 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6eb5ff43-426b-4aff-889c-42f3e6fefeba tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:15.565240 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6eb5ff43-426b-4aff-889c-42f3e6fefeba tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1576 microversion: 2.1 time: 0.177551 May 24 15:48:15.566178 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 471/989] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:15 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:16.588918 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-86584636-87c0-47a4-88c6-8c8005b9ff6c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:16.589880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-86584636-87c0-47a4-88c6-8c8005b9ff6c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:16.598921 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-86584636-87c0-47a4-88c6-8c8005b9ff6c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:16.599369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-86584636-87c0-47a4-88c6-8c8005b9ff6c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:16.600151 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-86584636-87c0-47a4-88c6-8c8005b9ff6c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:16.600584 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-86584636-87c0-47a4-88c6-8c8005b9ff6c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:16.767690 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-86584636-87c0-47a4-88c6-8c8005b9ff6c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:16.775634 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-86584636-87c0-47a4-88c6-8c8005b9ff6c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1576 microversion: 2.1 time: 0.193757 May 24 15:48:16.776766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 519/990] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:16 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:17.797226 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a9beb3b0-2be2-4d8e-8cbc-509242a34236 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:17.798220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a9beb3b0-2be2-4d8e-8cbc-509242a34236 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:17.805862 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9beb3b0-2be2-4d8e-8cbc-509242a34236 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:17.806309 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9beb3b0-2be2-4d8e-8cbc-509242a34236 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:17.807096 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9beb3b0-2be2-4d8e-8cbc-509242a34236 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:17.807514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a9beb3b0-2be2-4d8e-8cbc-509242a34236 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:18.005871 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a9beb3b0-2be2-4d8e-8cbc-509242a34236 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:18.015175 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a9beb3b0-2be2-4d8e-8cbc-509242a34236 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1576 microversion: 2.1 time: 0.224709 May 24 15:48:18.024980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 472/991] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:17 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:18.400008 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cf32fb36-a3e4-436d-a7b8-f4f862c0bc89 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "250f6715-5945-4977-9d9c-ec3bc1a0bf97"}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:18.401433 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-cf32fb36-a3e4-436d-a7b8-f4f862c0bc89 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:18.409908 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf32fb36-a3e4-436d-a7b8-f4f862c0bc89 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:18.409908 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf32fb36-a3e4-436d-a7b8-f4f862c0bc89 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:18.410624 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf32fb36-a3e4-436d-a7b8-f4f862c0bc89 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:18.411697 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf32fb36-a3e4-436d-a7b8-f4f862c0bc89 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:18.477078 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-750bb0e2-7435-4303-95e3-3cb5c40d33b1 req-cef943dc-7b81-4020-8536-faad684e9fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f052d1b5-52db-4a7f-9455-19439d077d63", "name": "network-vif-deleted", "tag": "32c2c21f-098c-426f-a69f-e6795e6db5ba"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:18.487579 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-750bb0e2-7435-4303-95e3-3cb5c40d33b1 req-cef943dc-7b81-4020-8536-faad684e9fb5 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:18.488474 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-750bb0e2-7435-4303-95e3-3cb5c40d33b1 req-cef943dc-7b81-4020-8536-faad684e9fb5 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:18.505564 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-750bb0e2-7435-4303-95e3-3cb5c40d33b1 req-cef943dc-7b81-4020-8536-faad684e9fb5 service nova] Creating event network-vif-deleted:32c2c21f-098c-426f-a69f-e6795e6db5ba for instance f052d1b5-52db-4a7f-9455-19439d077d63 on hv-cinder-84315 May 24 15:48:18.513356 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-750bb0e2-7435-4303-95e3-3cb5c40d33b1 req-cef943dc-7b81-4020-8536-faad684e9fb5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040816 May 24 15:48:18.515916 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 473/992] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:18.543745 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-cf32fb36-a3e4-436d-a7b8-f4f862c0bc89 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Invalid volume: volume 250f6715-5945-4977-9d9c-ec3bc1a0bf97 is already attached to instances: a71ea75e-0ceb-452a-ae87-90e9793528ad May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cf32fb36-a3e4-436d-a7b8-f4f862c0bc89 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: POST /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments HTTP/1.1 May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 74 May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:48:18.545722 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {"volumeAttachment": {"volumeId": "250f6715-5945-4977-9d9c-ec3bc1a0bf97"}} May 24 15:48:18.547627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Invalid volume: volume 250f6715-5945-4977-9d9c-ec3bc1a0bf97 is already attached to instances: a71ea75e-0ceb-452a-ae87-90e9793528ad May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'server_id': 'a71ea75e-0ceb-452a-ae87-90e9793528ad', 'body': {'volumeAttachment': {'volumeId': '250f6715-5945-4977-9d9c-ec3bc1a0bf97'}}} May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 250f6715-5945-4977-9d9c-ec3bc1a0bf97 is already attached to instances: a71ea75e-0ceb-452a-ae87-90e9793528ad May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:18.548749 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 250f6715-5945-4977-9d9c-ec3bc1a0bf97 is already attached to instances: a71ea75e-0ceb-452a-ae87-90e9793528ad May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:18.550318 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:18.552205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:18.552205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:48:18.552205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:48:18.552205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 250f6715-5945-4977-9d9c-ec3bc1a0bf97 is already attached to instances: a71ea75e-0ceb-452a-ae87-90e9793528ad May 24 15:48:18.552205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:18.552205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cf32fb36-a3e4-436d-a7b8-f4f862c0bc89 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 400 to user: Invalid volume: volume 250f6715-5945-4977-9d9c-ec3bc1a0bf97 is already attached to instances: a71ea75e-0ceb-452a-ae87-90e9793528ad {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:48:18.552205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cf32fb36-a3e4-436d-a7b8-f4f862c0bc89 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152225 May 24 15:48:18.552205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 520/993] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:48:18 2022] POST /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments => generated 174 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 15:48:18.636178 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-40cca7e7-8778-434d-8f91-db4176409e37 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:18.636848 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-40cca7e7-8778-434d-8f91-db4176409e37 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:18.643872 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-40cca7e7-8778-434d-8f91-db4176409e37 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:18.644407 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-40cca7e7-8778-434d-8f91-db4176409e37 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:18.645180 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-40cca7e7-8778-434d-8f91-db4176409e37 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:18.645613 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-40cca7e7-8778-434d-8f91-db4176409e37 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:18.728829 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-40cca7e7-8778-434d-8f91-db4176409e37 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lazy-loading 'services' on Instance uuid a71ea75e-0ceb-452a-ae87-90e9793528ad {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:48:18.806514 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-40cca7e7-8778-434d-8f91-db4176409e37 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments/250f6715-5945-4977-9d9c-ec3bc1a0bf97" status: 202 len: 0 microversion: 2.1 time: 0.175105 May 24 15:48:18.807246 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 474/994] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:48:18 2022] DELETE /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments/250f6715-5945-4977-9d9c-ec3bc1a0bf97 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:48:18.815831 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-5da80cc8-c937-4196-bec2-26264bcd661a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:18.816784 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-5da80cc8-c937-4196-bec2-26264bcd661a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:18.823233 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5da80cc8-c937-4196-bec2-26264bcd661a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:18.823910 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5da80cc8-c937-4196-bec2-26264bcd661a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:18.824702 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5da80cc8-c937-4196-bec2-26264bcd661a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:18.825297 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5da80cc8-c937-4196-bec2-26264bcd661a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:18.860466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-5da80cc8-c937-4196-bec2-26264bcd661a tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048763 May 24 15:48:18.861579 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 521/995] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:48:18 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:19.033689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2db39d8d-7c99-4b7a-a2b3-2c920473a6b9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:19.034283 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2db39d8d-7c99-4b7a-a2b3-2c920473a6b9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:19.040879 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2db39d8d-7c99-4b7a-a2b3-2c920473a6b9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:19.041325 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2db39d8d-7c99-4b7a-a2b3-2c920473a6b9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:19.042122 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2db39d8d-7c99-4b7a-a2b3-2c920473a6b9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:19.042798 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2db39d8d-7c99-4b7a-a2b3-2c920473a6b9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:19.108540 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2db39d8d-7c99-4b7a-a2b3-2c920473a6b9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:19.116731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2db39d8d-7c99-4b7a-a2b3-2c920473a6b9 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 200 len: 1224 microversion: 2.1 time: 0.087624 May 24 15:48:19.117304 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 475/996] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:19 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:19.874807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-5614e372-87b7-4652-87e0-bdd03e3ab7c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:19.876154 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-5614e372-87b7-4652-87e0-bdd03e3ab7c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:19.883381 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5614e372-87b7-4652-87e0-bdd03e3ab7c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:19.884477 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5614e372-87b7-4652-87e0-bdd03e3ab7c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:19.885245 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5614e372-87b7-4652-87e0-bdd03e3ab7c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:19.885847 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5614e372-87b7-4652-87e0-bdd03e3ab7c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:19.918218 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-5614e372-87b7-4652-87e0-bdd03e3ab7c8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048994 May 24 15:48:19.918784 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 522/997] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:48:19 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:48:19.982568 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-c7e04d0e-3087-4032-81c9-fdcbfa00422f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:19.983112 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c7e04d0e-3087-4032-81c9-fdcbfa00422f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:19.990137 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c7e04d0e-3087-4032-81c9-fdcbfa00422f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:19.990827 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c7e04d0e-3087-4032-81c9-fdcbfa00422f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:19.991978 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c7e04d0e-3087-4032-81c9-fdcbfa00422f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:19.992640 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-c7e04d0e-3087-4032-81c9-fdcbfa00422f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:20.018771 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-c7e04d0e-3087-4032-81c9-fdcbfa00422f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:48:20.100163 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-c7e04d0e-3087-4032-81c9-fdcbfa00422f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 204 len: 0 microversion: 2.1 time: 0.121071 May 24 15:48:20.100892 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 476/998] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:48:19 2022] DELETE /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:48:20.109660 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-46ba48ce-feb4-4300-91c7-9f51fd6a357b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:20.110265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-46ba48ce-feb4-4300-91c7-9f51fd6a357b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:20.116758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-46ba48ce-feb4-4300-91c7-9f51fd6a357b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:20.117197 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-46ba48ce-feb4-4300-91c7-9f51fd6a357b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:20.117945 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-46ba48ce-feb4-4300-91c7-9f51fd6a357b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:20.118370 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-46ba48ce-feb4-4300-91c7-9f51fd6a357b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:20.134445 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-af5cba75-f5da-4b56-81a2-3e3faccde2e6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:20.135142 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-af5cba75-f5da-4b56-81a2-3e3faccde2e6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: f052d1b5-52db-4a7f-9455-19439d077d63] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:20.141430 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-af5cba75-f5da-4b56-81a2-3e3faccde2e6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:20.141897 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-af5cba75-f5da-4b56-81a2-3e3faccde2e6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:20.142719 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-af5cba75-f5da-4b56-81a2-3e3faccde2e6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:20.143152 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-af5cba75-f5da-4b56-81a2-3e3faccde2e6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:20.156883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-af5cba75-f5da-4b56-81a2-3e3faccde2e6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] HTTP exception thrown: Instance f052d1b5-52db-4a7f-9455-19439d077d63 could not be found. May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-af5cba75-f5da-4b56-81a2-3e3faccde2e6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Request method failure captured: May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 HTTP/1.1 May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPyIQ-g2G4_6sjY84YEOfAHfxpPhW0DIprj7s7Q462wvMHAGyimX5GHKRinQJh8hoUC6_pJLByJeKuLDuEtWQ1sZyAE_qvOMtZJ0PfKu9xuP5PPUS_mtI9HVdkH4SL9U0SrJtppVhlEM6QHjUM4iHoJ_2VPxrLk0JEnhPPtW5d7C3UY May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: dc2810000275432fb1337151b6883e90 May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:48:20.158653 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dc2810000275432fb1337151b6883e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dc2810000275432fb1337151b6883e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dc2810000275432fb1337151b6883e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dc2810000275432fb1337151b6883e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: dc2810000275432fb1337151b6883e90 May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-TestVolumeBootPattern-1830429659-project May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0a3a64d88e89402b907789c7f030e080 May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-TestVolumeBootPattern-1830429659-project May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance f052d1b5-52db-4a7f-9455-19439d077d63 could not be found. May 24 15:48:20.160138 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'f052d1b5-52db-4a7f-9455-19439d077d63'} May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f052d1b5-52db-4a7f-9455-19439d077d63 could not be found. May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:48:20.160947 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f052d1b5-52db-4a7f-9455-19439d077d63 could not be found. May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f052d1b5-52db-4a7f-9455-19439d077d63 could not be found. May 24 15:48:20.162345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:20.163526 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-af5cba75-f5da-4b56-81a2-3e3faccde2e6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Returning 404 to user: Instance f052d1b5-52db-4a7f-9455-19439d077d63 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:48:20.163526 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-af5cba75-f5da-4b56-81a2-3e3faccde2e6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63" status: 404 len: 111 microversion: 2.1 time: 0.029931 May 24 15:48:20.163526 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 477/999] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:20 2022] GET /compute/v2.1/servers/f052d1b5-52db-4a7f-9455-19439d077d63 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:48:20.258038 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-46ba48ce-feb4-4300-91c7-9f51fd6a357b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:20.271465 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-46ba48ce-feb4-4300-91c7-9f51fd6a357b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1681 microversion: 2.1 time: 0.160311 May 24 15:48:20.271465 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 523/1000] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:20 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:21.287665 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-25cb300b-ba6c-4e4a-bae3-8abd015bdaf2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:21.288694 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-25cb300b-ba6c-4e4a-bae3-8abd015bdaf2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:21.298614 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-25cb300b-ba6c-4e4a-bae3-8abd015bdaf2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:21.299289 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-25cb300b-ba6c-4e4a-bae3-8abd015bdaf2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:21.300064 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-25cb300b-ba6c-4e4a-bae3-8abd015bdaf2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:21.300530 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-25cb300b-ba6c-4e4a-bae3-8abd015bdaf2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:21.437631 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-25cb300b-ba6c-4e4a-bae3-8abd015bdaf2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:21.449692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-25cb300b-ba6c-4e4a-bae3-8abd015bdaf2 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1681 microversion: 2.1 time: 0.167667 May 24 15:48:21.450483 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 478/1001] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:21 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:22.466969 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2479b104-9105-45ba-b528-a13d0813db08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:22.467620 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2479b104-9105-45ba-b528-a13d0813db08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:22.474748 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2479b104-9105-45ba-b528-a13d0813db08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:22.475291 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2479b104-9105-45ba-b528-a13d0813db08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:22.476089 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2479b104-9105-45ba-b528-a13d0813db08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:22.476796 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2479b104-9105-45ba-b528-a13d0813db08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:22.553006 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2479b104-9105-45ba-b528-a13d0813db08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:22.561554 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2479b104-9105-45ba-b528-a13d0813db08 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 200 len: 1613 microversion: 2.1 time: 0.098717 May 24 15:48:22.562332 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 524/1002] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:22 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 1613 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:22.677417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-d6bcf073-0e15-48ff-9ce3-7865a89772c5 req-61d53465-858b-4e69-aced-c7bf326c9307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a71ea75e-0ceb-452a-ae87-90e9793528ad", "name": "network-vif-deleted", "tag": "411b5ef0-37e3-4d18-ae3b-36ebfae36cf2"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:22.694992 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-d6bcf073-0e15-48ff-9ce3-7865a89772c5 req-61d53465-858b-4e69-aced-c7bf326c9307 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:22.695748 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-d6bcf073-0e15-48ff-9ce3-7865a89772c5 req-61d53465-858b-4e69-aced-c7bf326c9307 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:22.709708 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-d6bcf073-0e15-48ff-9ce3-7865a89772c5 req-61d53465-858b-4e69-aced-c7bf326c9307 service nova] Creating event network-vif-deleted:411b5ef0-37e3-4d18-ae3b-36ebfae36cf2 for instance a71ea75e-0ceb-452a-ae87-90e9793528ad on hv-cinder-84315 May 24 15:48:22.715898 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-d6bcf073-0e15-48ff-9ce3-7865a89772c5 req-61d53465-858b-4e69-aced-c7bf326c9307 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045844 May 24 15:48:22.716673 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 479/1003] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:23.349263 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-634b963d-0164-44d2-a2cb-d1a755c96f28 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:23.349815 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-634b963d-0164-44d2-a2cb-d1a755c96f28 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:23.351080 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-8d148f88-ca90-4f6a-989a-40377e9ac177 req-a2bf9129-8bfc-40b7-8c0d-735616d9718d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e3acf8-2dfa-4628-83d7-e7f1dbfe203f", "tag": "61128d49-e701-4c19-8cbf-602dcf947487"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:23.357231 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-634b963d-0164-44d2-a2cb-d1a755c96f28 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:23.357763 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-634b963d-0164-44d2-a2cb-d1a755c96f28 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:23.358639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-634b963d-0164-44d2-a2cb-d1a755c96f28 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:23.359147 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-634b963d-0164-44d2-a2cb-d1a755c96f28 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:23.366239 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-8d148f88-ca90-4f6a-989a-40377e9ac177 req-a2bf9129-8bfc-40b7-8c0d-735616d9718d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:23.366997 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-8d148f88-ca90-4f6a-989a-40377e9ac177 req-a2bf9129-8bfc-40b7-8c0d-735616d9718d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:23.379002 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-8d148f88-ca90-4f6a-989a-40377e9ac177 req-a2bf9129-8bfc-40b7-8c0d-735616d9718d service nova] Creating event network-changed:61128d49-e701-4c19-8cbf-602dcf947487 for instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f on hv-cinder-84315 May 24 15:48:23.384625 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-8d148f88-ca90-4f6a-989a-40377e9ac177 req-a2bf9129-8bfc-40b7-8c0d-735616d9718d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037667 May 24 15:48:23.385687 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 480/1004] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:48:23.385997 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-634b963d-0164-44d2-a2cb-d1a755c96f28 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Going to try to terminate instance {{(pid=129340) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:48:23.493976 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-634b963d-0164-44d2-a2cb-d1a755c96f28 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "DELETE /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 204 len: 0 microversion: 2.1 time: 0.149761 May 24 15:48:23.494965 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 525/1005] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:48:23 2022] DELETE /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:48:23.503462 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-fa89bbbf-93e6-4455-a06b-45d412051d4d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:23.504486 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-fa89bbbf-93e6-4455-a06b-45d412051d4d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:23.510957 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fa89bbbf-93e6-4455-a06b-45d412051d4d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:23.518022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fa89bbbf-93e6-4455-a06b-45d412051d4d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:23.518022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fa89bbbf-93e6-4455-a06b-45d412051d4d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:23.518022 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-fa89bbbf-93e6-4455-a06b-45d412051d4d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:23.579655 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4196a165-a75f-492f-9107-25abc4acbfd4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:23.580799 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-4196a165-a75f-492f-9107-25abc4acbfd4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:23.595673 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4196a165-a75f-492f-9107-25abc4acbfd4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:23.596517 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4196a165-a75f-492f-9107-25abc4acbfd4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:23.598654 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4196a165-a75f-492f-9107-25abc4acbfd4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:23.599100 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-4196a165-a75f-492f-9107-25abc4acbfd4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:23.621598 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-4196a165-a75f-492f-9107-25abc4acbfd4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4196a165-a75f-492f-9107-25abc4acbfd4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad HTTP/1.1 May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:48:23.625450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:48:23.627012 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'a71ea75e-0ceb-452a-ae87-90e9793528ad'} May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:48:23.627825 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:48:23.629158 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:23.635492 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-4196a165-a75f-492f-9107-25abc4acbfd4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:48:23.636931 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-4196a165-a75f-492f-9107-25abc4acbfd4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 404 len: 111 microversion: 2.1 time: 0.061383 May 24 15:48:23.639417 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 526/1006] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:23 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:48:23.647631 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-af21fa93-1c05-496d-a121-3ead736f902e tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '.version_select at 0x7fb1d48e9f70>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:23.679077 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-af21fa93-1c05-496d-a121-3ead736f902e tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-816735434" status: 202 len: 0 microversion: 2.1 time: 0.034967 May 24 15:48:23.680296 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 527/1007] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 24 15:48:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-816735434 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:48:23.699508 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-fa89bbbf-93e6-4455-a06b-45d412051d4d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:23.708019 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-fa89bbbf-93e6-4455-a06b-45d412051d4d tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1576 microversion: 2.1 time: 0.208749 May 24 15:48:23.717398 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 481/1008] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:23 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:24.399074 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c3999d0b-25bc-458f-b69b-81e55366af19 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: .version_select at 0x7fb1d472a3a0>, body: {"keypair": {"name": "tempest-keypair-287550052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+S9prH4TPSoykxeMeYWaj90ohYe3eE/j67ZAx7lYy3Kv0aKKhNkCKvMNTJ8adMiTKBa7ILUPMRYvjelytQu/Mmv4/ZtdNO7cOi1V+Ds7xifUY0FkDv0qmgMM/6eWwRA=="}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:24.415109 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-c3999d0b-25bc-458f-b69b-81e55366af19 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for project a30edd891b96456fbba6409a815f5fd8. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:48:24.419507 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-c3999d0b-25bc-458f-b69b-81e55366af19 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for user 0f8105d1de0d45218576d74a2ba4abe4 and project a30edd891b96456fbba6409a815f5fd8. Resources: {'key_pairs'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:48:24.443861 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c3999d0b-25bc-458f-b69b-81e55366af19 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048958 May 24 15:48:24.444536 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 528/1009] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 24 15:48:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:24.730198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2230d622-db35-4c49-af0d-84ca09f05a25 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:24.730808 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-2230d622-db35-4c49-af0d-84ca09f05a25 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:24.738686 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2230d622-db35-4c49-af0d-84ca09f05a25 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:24.739127 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2230d622-db35-4c49-af0d-84ca09f05a25 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:24.739898 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2230d622-db35-4c49-af0d-84ca09f05a25 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:24.740361 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-2230d622-db35-4c49-af0d-84ca09f05a25 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:24.995160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-2230d622-db35-4c49-af0d-84ca09f05a25 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:25.004473 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2230d622-db35-4c49-af0d-84ca09f05a25 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1576 microversion: 2.1 time: 0.281076 May 24 15:48:25.005097 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 482/1010] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:24 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1576 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:26.026064 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cf2fff78-6262-4590-8405-6f3d87dcfbb6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:26.026865 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-cf2fff78-6262-4590-8405-6f3d87dcfbb6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:26.033634 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf2fff78-6262-4590-8405-6f3d87dcfbb6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:26.034134 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf2fff78-6262-4590-8405-6f3d87dcfbb6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:26.035194 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf2fff78-6262-4590-8405-6f3d87dcfbb6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:26.035693 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cf2fff78-6262-4590-8405-6f3d87dcfbb6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:26.124614 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-cf2fff78-6262-4590-8405-6f3d87dcfbb6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a64d88e89402b907789c7f030e080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2810000275432fb1337151b6883e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:26.144284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cf2fff78-6262-4590-8405-6f3d87dcfbb6 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 200 len: 1390 microversion: 2.1 time: 0.124900 May 24 15:48:26.146078 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 529/1011] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:26 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 1390 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:26.219736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-c16de3c0-57d3-4598-aad3-40aecb9b4049 req-aad1d75a-f89b-49e1-add8-a2a427110804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e3acf8-2dfa-4628-83d7-e7f1dbfe203f", "name": "network-vif-deleted", "tag": "61128d49-e701-4c19-8cbf-602dcf947487"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:26.230095 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-c16de3c0-57d3-4598-aad3-40aecb9b4049 req-aad1d75a-f89b-49e1-add8-a2a427110804 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:26.230525 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-c16de3c0-57d3-4598-aad3-40aecb9b4049 req-aad1d75a-f89b-49e1-add8-a2a427110804 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:26.243401 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-c16de3c0-57d3-4598-aad3-40aecb9b4049 req-aad1d75a-f89b-49e1-add8-a2a427110804 service nova] Creating event network-vif-deleted:61128d49-e701-4c19-8cbf-602dcf947487 for instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f on hv-cinder-84315 May 24 15:48:26.256992 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-c16de3c0-57d3-4598-aad3-40aecb9b4049 req-aad1d75a-f89b-49e1-add8-a2a427110804 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043171 May 24 15:48:26.257920 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 483/1012] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:48:26.686979 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1107161569", "imageRef": "a9966b92-e4a5-4d42-8f70-ac2d2f93cda6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1eca94ca-2475-4c7a-b305-a2f26b6c82f9"}], "security_groups": [{"name": "tempest-securitygroup--1217754142"}], "key_name": "tempest-keypair-287550052", "user_data": "}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:26.801799 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] validate_networks() for [('1eca94ca-2475-4c7a-b305-a2f26b6c82f9', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:48:27.162979 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3b6d3bd0-f923-4bcc-ac75-6ffb36966af3 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:27.163688 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3b6d3bd0-f923-4bcc-ac75-6ffb36966af3 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:27.170719 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3b6d3bd0-f923-4bcc-ac75-6ffb36966af3 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:27.171205 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3b6d3bd0-f923-4bcc-ac75-6ffb36966af3 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:27.171930 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3b6d3bd0-f923-4bcc-ac75-6ffb36966af3 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:27.172891 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3b6d3bd0-f923-4bcc-ac75-6ffb36966af3 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:27.187638 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-3b6d3bd0-f923-4bcc-ac75-6ffb36966af3 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] HTTP exception thrown: Instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f could not be found. May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3b6d3bd0-f923-4bcc-ac75-6ffb36966af3 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Request method failure captured: May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f HTTP/1.1 May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPyIQ-g2G4_6sjY84YEOfAHfxpPhW0DIprj7s7Q462wvMHAGyimX5GHKRinQJh8hoUC6_pJLByJeKuLDuEtWQ1sZyAE_qvOMtZJ0PfKu9xuP5PPUS_mtI9HVdkH4SL9U0SrJtppVhlEM6QHjUM4iHoJ_2VPxrLk0JEnhPPtW5d7C3UY May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: dc2810000275432fb1337151b6883e90 May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:48:27.189603 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dc2810000275432fb1337151b6883e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dc2810000275432fb1337151b6883e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dc2810000275432fb1337151b6883e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dc2810000275432fb1337151b6883e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: dc2810000275432fb1337151b6883e90 May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-TestVolumeBootPattern-1830429659-project May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0a3a64d88e89402b907789c7f030e080 May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-TestVolumeBootPattern-1830429659-project May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f could not be found. May 24 15:48:27.191257 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': '23e3acf8-2dfa-4628-83d7-e7f1dbfe203f'} May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f could not be found. May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:48:27.192187 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f could not be found. May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f could not be found. May 24 15:48:27.194689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:27.196734 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3b6d3bd0-f923-4bcc-ac75-6ffb36966af3 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Returning 404 to user: Instance 23e3acf8-2dfa-4628-83d7-e7f1dbfe203f could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:48:27.196734 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3b6d3bd0-f923-4bcc-ac75-6ffb36966af3 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f" status: 404 len: 111 microversion: 2.1 time: 0.033061 May 24 15:48:27.196734 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 484/1013] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:27 2022] GET /compute/v2.1/servers/23e3acf8-2dfa-4628-83d7-e7f1dbfe203f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:48:27.448780 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:48:27.449302 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:48:27.449670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:48:27.450046 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:48:27.450447 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:48:27.461532 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:27.462117 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:27.463546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:27.464500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:27.483008 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for project a30edd891b96456fbba6409a815f5fd8. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:48:27.487648 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Getting quotas for user 0f8105d1de0d45218576d74a2ba4abe4 and project a30edd891b96456fbba6409a815f5fd8. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:48:27.503107 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:48:27.505655 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9966b92-e4a5-4d42-8f70-ac2d2f93cda6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:48:27.556683 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-745c118b-29d1-4e76-b08a-a2fb5f50293b tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.875469 May 24 15:48:27.557667 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 530/1014] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:48:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:48:27.569698 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1c2c522b-e7f1-47aa-873e-52ccca84561f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:27.571017 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1c2c522b-e7f1-47aa-873e-52ccca84561f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:27.852448 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1c2c522b-e7f1-47aa-873e-52ccca84561f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:27.864590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1c2c522b-e7f1-47aa-873e-52ccca84561f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1241 microversion: 2.1 time: 0.298443 May 24 15:48:27.866098 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 485/1015] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:27 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1241 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:28.075703 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-751fb225-83b2-471c-849b-c4a6b952cdb4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:28.076424 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-751fb225-83b2-471c-849b-c4a6b952cdb4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:28.088282 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-751fb225-83b2-471c-849b-c4a6b952cdb4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:28.089757 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-751fb225-83b2-471c-849b-c4a6b952cdb4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:28.091201 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-751fb225-83b2-471c-849b-c4a6b952cdb4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:28.091903 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-751fb225-83b2-471c-849b-c4a6b952cdb4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:28.107610 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-751fb225-83b2-471c-849b-c4a6b952cdb4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] HTTP exception thrown: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-751fb225-83b2-471c-849b-c4a6b952cdb4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Request method failure captured: May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: DELETE /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef HTTP/1.1 May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijPyIQ-g2G4_6sjY84YEOfAHfxpPhW0DIprj7s7Q462wvMHAGyimX5GHKRinQJh8hoUC6_pJLByJeKuLDuEtWQ1sZyAE_qvOMtZJ0PfKu9xuP5PPUS_mtI9HVdkH4SL9U0SrJtppVhlEM6QHjUM4iHoJ_2VPxrLk0JEnhPPtW5d7C3UY May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: dc2810000275432fb1337151b6883e90 May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:48:28.109793 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dc2810000275432fb1337151b6883e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dc2810000275432fb1337151b6883e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dc2810000275432fb1337151b6883e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dc2810000275432fb1337151b6883e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: dc2810000275432fb1337151b6883e90 May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-TestVolumeBootPattern-1830429659-project May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 0a3a64d88e89402b907789c7f030e080 May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-TestVolumeBootPattern-1830429659-project May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:48:28.111356 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '6ac339a5-757e-4d9d-9216-7a2a399b8fef'} May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:48:28.112176 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:48:28.113428 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:48:28.114750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-751fb225-83b2-471c-849b-c4a6b952cdb4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Returning 404 to user: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:48:28.114750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-751fb225-83b2-471c-849b-c4a6b952cdb4 tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 404 len: 111 microversion: 2.1 time: 0.041847 May 24 15:48:28.114750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 531/1016] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:48:28 2022] DELETE /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:48:28.120520 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-06fba722-968b-400d-9e42-6fcfbb32db8f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:28.121133 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-06fba722-968b-400d-9e42-6fcfbb32db8f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] [instance: 6ac339a5-757e-4d9d-9216-7a2a399b8fef] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:28.130220 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-06fba722-968b-400d-9e42-6fcfbb32db8f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:28.131024 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-06fba722-968b-400d-9e42-6fcfbb32db8f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:28.132000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-06fba722-968b-400d-9e42-6fcfbb32db8f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:28.132677 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-06fba722-968b-400d-9e42-6fcfbb32db8f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:28.153698 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-06fba722-968b-400d-9e42-6fcfbb32db8f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] HTTP exception thrown: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-06fba722-968b-400d-9e42-6fcfbb32db8f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Request method failure captured: May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef HTTP/1.1 May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijPyIQ-g2G4_6sjY84YEOfAHfxpPhW0DIprj7s7Q462wvMHAGyimX5GHKRinQJh8hoUC6_pJLByJeKuLDuEtWQ1sZyAE_qvOMtZJ0PfKu9xuP5PPUS_mtI9HVdkH4SL9U0SrJtppVhlEM6QHjUM4iHoJ_2VPxrLk0JEnhPPtW5d7C3UY May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: dc2810000275432fb1337151b6883e90 May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:48:28.155088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dc2810000275432fb1337151b6883e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_dc2810000275432fb1337151b6883e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/dc2810000275432fb1337151b6883e90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/dc2810000275432fb1337151b6883e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: dc2810000275432fb1337151b6883e90 May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-TestVolumeBootPattern-1830429659 May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-TestVolumeBootPattern-1830429659-project May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0a3a64d88e89402b907789c7f030e080 May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-TestVolumeBootPattern-1830429659-project May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:48:28.156590 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': '6ac339a5-757e-4d9d-9216-7a2a399b8fef'} May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:48:28.158216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. May 24 15:48:28.159849 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:48:28.161535 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-06fba722-968b-400d-9e42-6fcfbb32db8f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Returning 404 to user: Instance 6ac339a5-757e-4d9d-9216-7a2a399b8fef could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:48:28.161535 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-06fba722-968b-400d-9e42-6fcfbb32db8f tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef" status: 404 len: 111 microversion: 2.1 time: 0.039841 May 24 15:48:28.161535 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 486/1017] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:28 2022] GET /compute/v2.1/servers/6ac339a5-757e-4d9d-9216-7a2a399b8fef => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:48:28.884159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c5a865fc-e333-4c11-87b4-87ded9db1701 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:28.884159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c5a865fc-e333-4c11-87b4-87ded9db1701 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:28.890213 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c5a865fc-e333-4c11-87b4-87ded9db1701 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:28.890836 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c5a865fc-e333-4c11-87b4-87ded9db1701 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:28.891833 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c5a865fc-e333-4c11-87b4-87ded9db1701 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:28.892960 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c5a865fc-e333-4c11-87b4-87ded9db1701 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:28.976474 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c5a865fc-e333-4c11-87b4-87ded9db1701 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:28.994284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c5a865fc-e333-4c11-87b4-87ded9db1701 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1311 microversion: 2.1 time: 0.116164 May 24 15:48:28.994930 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 532/1018] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:28 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1311 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:29.502723 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-211a607a-8154-40aa-bf81-079878579c3c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] Calling method '.version_select at 0x7fb1d70c10d0>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:29.529457 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-211a607a-8154-40aa-bf81-079878579c3c tempest-TestVolumeBootPattern-1830429659 tempest-TestVolumeBootPattern-1830429659-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-466910550" status: 202 len: 0 microversion: 2.1 time: 0.030463 May 24 15:48:29.530359 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 487/1019] 10.222.0.55 () {58 vars in 1259 bytes} [Tue May 24 15:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-466910550 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:48:30.011261 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-6458e504-2518-4eb2-868b-ea04b9804679 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:30.012164 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-6458e504-2518-4eb2-868b-ea04b9804679 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:30.020310 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6458e504-2518-4eb2-868b-ea04b9804679 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:30.020873 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6458e504-2518-4eb2-868b-ea04b9804679 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:30.022518 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6458e504-2518-4eb2-868b-ea04b9804679 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:30.023167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-6458e504-2518-4eb2-868b-ea04b9804679 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:30.323662 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-6458e504-2518-4eb2-868b-ea04b9804679 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:30.333330 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-6458e504-2518-4eb2-868b-ea04b9804679 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1367 microversion: 2.1 time: 0.326241 May 24 15:48:30.334282 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 533/1020] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:30 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:30.471445 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-03d4d67b-e375-4339-ba7b-37cf0f46ffc3 req-1c8ad5d2-833a-4c31-b43d-c91f35d64637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6677127b-9689-4fca-a172-8c1ab49d8146", "tag": "f8cc646b-86d0-47e0-ad8f-969bf944f27a"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:30.495149 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-03d4d67b-e375-4339-ba7b-37cf0f46ffc3 req-1c8ad5d2-833a-4c31-b43d-c91f35d64637 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:30.495625 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-03d4d67b-e375-4339-ba7b-37cf0f46ffc3 req-1c8ad5d2-833a-4c31-b43d-c91f35d64637 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:30.513387 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-03d4d67b-e375-4339-ba7b-37cf0f46ffc3 req-1c8ad5d2-833a-4c31-b43d-c91f35d64637 service nova] Creating event network-changed:f8cc646b-86d0-47e0-ad8f-969bf944f27a for instance 6677127b-9689-4fca-a172-8c1ab49d8146 on hv-cinder-84315 May 24 15:48:30.519388 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-03d4d67b-e375-4339-ba7b-37cf0f46ffc3 req-1c8ad5d2-833a-4c31-b43d-c91f35d64637 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066389 May 24 15:48:30.520066 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 488/1021] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:31.351296 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0ece3cdd-b92b-4108-81a7-093530d5632d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:31.352183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0ece3cdd-b92b-4108-81a7-093530d5632d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:31.359266 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0ece3cdd-b92b-4108-81a7-093530d5632d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:31.359919 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0ece3cdd-b92b-4108-81a7-093530d5632d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:31.360903 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0ece3cdd-b92b-4108-81a7-093530d5632d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:31.361470 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0ece3cdd-b92b-4108-81a7-093530d5632d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:31.381665 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:31.633207 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0ece3cdd-b92b-4108-81a7-093530d5632d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:31.641868 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0ece3cdd-b92b-4108-81a7-093530d5632d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1367 microversion: 2.1 time: 0.294533 May 24 15:48:31.642996 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 534/1022] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:31 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:32.660205 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-aae747e2-da68-4c3f-ab5f-6bc87e9d020f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:32.660894 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-aae747e2-da68-4c3f-ab5f-6bc87e9d020f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:32.675115 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aae747e2-da68-4c3f-ab5f-6bc87e9d020f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:32.675498 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aae747e2-da68-4c3f-ab5f-6bc87e9d020f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:32.676289 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aae747e2-da68-4c3f-ab5f-6bc87e9d020f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:32.676712 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-aae747e2-da68-4c3f-ab5f-6bc87e9d020f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:32.874787 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-aae747e2-da68-4c3f-ab5f-6bc87e9d020f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:32.880792 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:32.897513 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-aae747e2-da68-4c3f-ab5f-6bc87e9d020f tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1367 microversion: 2.1 time: 0.241726 May 24 15:48:32.907753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 489/1023] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:32 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:33.915696 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-53ffbaed-57be-4ad1-b63d-218f1aff889d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:33.917266 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-53ffbaed-57be-4ad1-b63d-218f1aff889d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:33.924241 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-53ffbaed-57be-4ad1-b63d-218f1aff889d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:33.924878 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-53ffbaed-57be-4ad1-b63d-218f1aff889d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:33.925779 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-53ffbaed-57be-4ad1-b63d-218f1aff889d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:33.926431 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-53ffbaed-57be-4ad1-b63d-218f1aff889d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:34.110551 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-53ffbaed-57be-4ad1-b63d-218f1aff889d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:34.126015 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-53ffbaed-57be-4ad1-b63d-218f1aff889d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1367 microversion: 2.1 time: 0.214643 May 24 15:48:34.127216 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 535/1024] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:33 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:35.144791 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a755f52b-483d-42cf-8765-e7f5ca6ad028 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:35.145403 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a755f52b-483d-42cf-8765-e7f5ca6ad028 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:35.153092 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a755f52b-483d-42cf-8765-e7f5ca6ad028 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:35.156692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a755f52b-483d-42cf-8765-e7f5ca6ad028 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:35.158333 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a755f52b-483d-42cf-8765-e7f5ca6ad028 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:35.158846 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a755f52b-483d-42cf-8765-e7f5ca6ad028 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:35.365182 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a755f52b-483d-42cf-8765-e7f5ca6ad028 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:35.374359 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a755f52b-483d-42cf-8765-e7f5ca6ad028 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1367 microversion: 2.1 time: 0.233543 May 24 15:48:35.375081 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 490/1025] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:35 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:35.568476 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-532db4e9-9780-4ce9-8c73-1e1c86d0393d req-ab0dbc73-72d6-4fa3-b218-8047dc4f4d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6677127b-9689-4fca-a172-8c1ab49d8146", "name": "network-vif-plugged", "status": "completed", "tag": "f8cc646b-86d0-47e0-ad8f-969bf944f27a"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:35.577264 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-532db4e9-9780-4ce9-8c73-1e1c86d0393d req-ab0dbc73-72d6-4fa3-b218-8047dc4f4d7d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:35.578121 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-532db4e9-9780-4ce9-8c73-1e1c86d0393d req-ab0dbc73-72d6-4fa3-b218-8047dc4f4d7d service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:35.590123 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-532db4e9-9780-4ce9-8c73-1e1c86d0393d req-ab0dbc73-72d6-4fa3-b218-8047dc4f4d7d service nova] Creating event network-vif-plugged:f8cc646b-86d0-47e0-ad8f-969bf944f27a for instance 6677127b-9689-4fca-a172-8c1ab49d8146 on hv-cinder-84315 May 24 15:48:35.596360 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-532db4e9-9780-4ce9-8c73-1e1c86d0393d req-ab0dbc73-72d6-4fa3-b218-8047dc4f4d7d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031323 May 24 15:48:35.597888 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 536/1026] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:36.391648 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4e151ccc-dd2e-41e5-a994-2bcb2e996ac1 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:36.392485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4e151ccc-dd2e-41e5-a994-2bcb2e996ac1 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:36.399249 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4e151ccc-dd2e-41e5-a994-2bcb2e996ac1 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:36.399813 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4e151ccc-dd2e-41e5-a994-2bcb2e996ac1 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:36.400708 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4e151ccc-dd2e-41e5-a994-2bcb2e996ac1 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:36.401237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4e151ccc-dd2e-41e5-a994-2bcb2e996ac1 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:36.573607 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-4e151ccc-dd2e-41e5-a994-2bcb2e996ac1 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:36.582372 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4e151ccc-dd2e-41e5-a994-2bcb2e996ac1 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1367 microversion: 2.1 time: 0.195461 May 24 15:48:36.583040 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 491/1027] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:36 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:37.597732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:37.598750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=10 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:37.604745 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0dca8238-96c5-435c-bfe5-91c3cc4a8088 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:37.609121 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0dca8238-96c5-435c-bfe5-91c3cc4a8088 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:37.629668 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0dca8238-96c5-435c-bfe5-91c3cc4a8088 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:37.630352 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0dca8238-96c5-435c-bfe5-91c3cc4a8088 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:37.631892 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0dca8238-96c5-435c-bfe5-91c3cc4a8088 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:37.632583 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0dca8238-96c5-435c-bfe5-91c3cc4a8088 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:37.897416 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-0dca8238-96c5-435c-bfe5-91c3cc4a8088 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:48:37.906803 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0dca8238-96c5-435c-bfe5-91c3cc4a8088 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1556 microversion: 2.1 time: 0.310910 May 24 15:48:37.910879 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 537/1028] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:48:37 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1556 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:48:37.925695 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-281dcf1e-2ef2-4cd6-aa67-08f5b07f0ab4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:48:37.926515 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-281dcf1e-2ef2-4cd6-aa67-08f5b07f0ab4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:48:37.928889 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:48:37.935292 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-281dcf1e-2ef2-4cd6-aa67-08f5b07f0ab4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:37.935882 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-281dcf1e-2ef2-4cd6-aa67-08f5b07f0ab4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:37.936654 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-281dcf1e-2ef2-4cd6-aa67-08f5b07f0ab4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:37.937150 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-281dcf1e-2ef2-4cd6-aa67-08f5b07f0ab4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:38.024293 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-281dcf1e-2ef2-4cd6-aa67-08f5b07f0ab4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103912 May 24 15:48:38.025188 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 492/1029] 10.222.0.55 () {58 vars in 1274 bytes} [Tue May 24 15:48:37 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:48:39.079715 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-f4250b67-d9af-4fc1-9ad6-8510d2efd619 req-d1dcf3aa-ca7a-46a3-96e4-7e9b541698a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6677127b-9689-4fca-a172-8c1ab49d8146", "tag": "f8cc646b-86d0-47e0-ad8f-969bf944f27a"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:48:39.097430 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-f4250b67-d9af-4fc1-9ad6-8510d2efd619 req-d1dcf3aa-ca7a-46a3-96e4-7e9b541698a4 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:48:39.098040 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-f4250b67-d9af-4fc1-9ad6-8510d2efd619 req-d1dcf3aa-ca7a-46a3-96e4-7e9b541698a4 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:48:39.118143 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-f4250b67-d9af-4fc1-9ad6-8510d2efd619 req-d1dcf3aa-ca7a-46a3-96e4-7e9b541698a4 service nova] Creating event network-changed:f8cc646b-86d0-47e0-ad8f-969bf944f27a for instance 6677127b-9689-4fca-a172-8c1ab49d8146 on hv-cinder-84315 May 24 15:48:39.123835 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-f4250b67-d9af-4fc1-9ad6-8510d2efd619 req-d1dcf3aa-ca7a-46a3-96e4-7e9b541698a4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048124 May 24 15:48:39.124809 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 538/1030] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:49:08.613088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:49:08.613997 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=16 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:49:08.619150 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-acf4020e-8962-437c-9af9-b1c8866018d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:08.619711 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-acf4020e-8962-437c-9af9-b1c8866018d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:08.628017 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-acf4020e-8962-437c-9af9-b1c8866018d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:08.628475 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-acf4020e-8962-437c-9af9-b1c8866018d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:08.629226 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-acf4020e-8962-437c-9af9-b1c8866018d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:08.629649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-acf4020e-8962-437c-9af9-b1c8866018d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:08.654531 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-acf4020e-8962-437c-9af9-b1c8866018d3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/ips" status: 200 len: 149 microversion: 2.1 time: 0.042975 May 24 15:49:08.655006 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 493/1031] 10.222.0.55 () {58 vars in 1247 bytes} [Tue May 24 15:49:08 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:49:10.005626 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7f0c6666-da8e-4ea8-895e-9c7ad72cbee3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74337cd1-26eb-44cf-8fc0-8a490df38e57"}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:49:10.006761 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7f0c6666-da8e-4ea8-895e-9c7ad72cbee3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:10.009068 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:49:10.009692 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=18 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:49:10.016440 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f0c6666-da8e-4ea8-895e-9c7ad72cbee3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:10.016863 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f0c6666-da8e-4ea8-895e-9c7ad72cbee3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:10.017669 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f0c6666-da8e-4ea8-895e-9c7ad72cbee3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:10.018092 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7f0c6666-da8e-4ea8-895e-9c7ad72cbee3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:10.330707 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7f0c6666-da8e-4ea8-895e-9c7ad72cbee3 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "POST /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329226 May 24 15:49:10.331500 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 539/1032] 10.222.0.55 () {60 vars in 1322 bytes} [Tue May 24 15:49:09 2022] POST /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:49:17.973291 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-27086441-f9b7-4ad8-8317-c8421fd2602d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:17.973809 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-27086441-f9b7-4ad8-8317-c8421fd2602d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:17.980612 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27086441-f9b7-4ad8-8317-c8421fd2602d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:17.981077 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27086441-f9b7-4ad8-8317-c8421fd2602d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:17.981837 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27086441-f9b7-4ad8-8317-c8421fd2602d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:17.982267 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-27086441-f9b7-4ad8-8317-c8421fd2602d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:18.065952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-27086441-f9b7-4ad8-8317-c8421fd2602d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lazy-loading 'services' on Instance uuid 6677127b-9689-4fca-a172-8c1ab49d8146 {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:49:18.153643 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-27086441-f9b7-4ad8-8317-c8421fd2602d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/os-volume_attachments/74337cd1-26eb-44cf-8fc0-8a490df38e57" status: 202 len: 0 microversion: 2.1 time: 0.184137 May 24 15:49:18.154340 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 494/1033] 10.222.0.55 () {58 vars in 1415 bytes} [Tue May 24 15:49:17 2022] DELETE /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/os-volume_attachments/74337cd1-26eb-44cf-8fc0-8a490df38e57 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:49:18.163803 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-766794cc-af66-4d52-b272-20e239beeddf tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:18.165045 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-766794cc-af66-4d52-b272-20e239beeddf tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:18.172666 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-766794cc-af66-4d52-b272-20e239beeddf tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:18.173183 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-766794cc-af66-4d52-b272-20e239beeddf tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:18.174512 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-766794cc-af66-4d52-b272-20e239beeddf tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:18.175174 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-766794cc-af66-4d52-b272-20e239beeddf tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:18.211498 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-766794cc-af66-4d52-b272-20e239beeddf tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051986 May 24 15:49:18.212083 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 540/1034] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:49:18 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:49:19.231627 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-edeb6068-40a7-42a0-bb48-1c81866a8199 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:19.232764 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-edeb6068-40a7-42a0-bb48-1c81866a8199 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:19.239925 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-edeb6068-40a7-42a0-bb48-1c81866a8199 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:19.240417 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-edeb6068-40a7-42a0-bb48-1c81866a8199 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:19.241206 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-edeb6068-40a7-42a0-bb48-1c81866a8199 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:19.241655 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-edeb6068-40a7-42a0-bb48-1c81866a8199 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:19.271438 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-edeb6068-40a7-42a0-bb48-1c81866a8199 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047745 May 24 15:49:19.271967 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 495/1035] 10.222.0.55 () {58 vars in 1301 bytes} [Tue May 24 15:49:19 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 15:49:19.338733 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2550490e-511d-4e44-8114-011fd02d44dc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:19.339247 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2550490e-511d-4e44-8114-011fd02d44dc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:19.346087 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2550490e-511d-4e44-8114-011fd02d44dc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:19.346528 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2550490e-511d-4e44-8114-011fd02d44dc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:19.347284 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2550490e-511d-4e44-8114-011fd02d44dc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:19.347716 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2550490e-511d-4e44-8114-011fd02d44dc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:19.372876 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2550490e-511d-4e44-8114-011fd02d44dc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Going to try to terminate instance {{(pid=129340) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:49:19.457962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2550490e-511d-4e44-8114-011fd02d44dc tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 204 len: 0 microversion: 2.1 time: 0.122765 May 24 15:49:19.458782 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 541/1036] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:49:19 2022] DELETE /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:49:19.466889 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5542c318-42c5-4940-a2d9-b4bd582272d9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:19.467500 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5542c318-42c5-4940-a2d9-b4bd582272d9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:19.473830 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5542c318-42c5-4940-a2d9-b4bd582272d9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:19.474286 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5542c318-42c5-4940-a2d9-b4bd582272d9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:19.475045 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5542c318-42c5-4940-a2d9-b4bd582272d9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:19.475482 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5542c318-42c5-4940-a2d9-b4bd582272d9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:19.626710 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5542c318-42c5-4940-a2d9-b4bd582272d9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:49:19.638558 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5542c318-42c5-4940-a2d9-b4bd582272d9 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1681 microversion: 2.1 time: 0.175290 May 24 15:49:19.639396 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 496/1037] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:49:19 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:49:20.661277 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-80ae8393-0977-4924-bc2d-76be55e15efd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:20.662371 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-80ae8393-0977-4924-bc2d-76be55e15efd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:20.671678 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80ae8393-0977-4924-bc2d-76be55e15efd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:20.672155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80ae8393-0977-4924-bc2d-76be55e15efd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:20.672924 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80ae8393-0977-4924-bc2d-76be55e15efd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:20.673347 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-80ae8393-0977-4924-bc2d-76be55e15efd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:20.812555 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-80ae8393-0977-4924-bc2d-76be55e15efd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:49:20.820250 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-80ae8393-0977-4924-bc2d-76be55e15efd tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1681 microversion: 2.1 time: 0.166162 May 24 15:49:20.820815 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 542/1038] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:49:20 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:49:21.837181 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-1236ea2f-f9a0-4787-9cf1-3b600d2e7aa4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:21.837934 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-1236ea2f-f9a0-4787-9cf1-3b600d2e7aa4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:21.847129 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1236ea2f-f9a0-4787-9cf1-3b600d2e7aa4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:21.847692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1236ea2f-f9a0-4787-9cf1-3b600d2e7aa4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:21.848596 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1236ea2f-f9a0-4787-9cf1-3b600d2e7aa4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:21.849108 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-1236ea2f-f9a0-4787-9cf1-3b600d2e7aa4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:21.926940 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-1236ea2f-f9a0-4787-9cf1-3b600d2e7aa4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8105d1de0d45218576d74a2ba4abe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30edd891b96456fbba6409a815f5fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:49:21.937299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-1236ea2f-f9a0-4787-9cf1-3b600d2e7aa4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 200 len: 1613 microversion: 2.1 time: 0.104050 May 24 15:49:21.938212 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 497/1039] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:49:21 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 1613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:49:22.138920 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-b510ff0c-4ab5-4bc7-be51-9cd27b9f88e0 req-80193b17-7c0a-490a-b4e9-c35ae61c94a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6677127b-9689-4fca-a172-8c1ab49d8146", "name": "network-vif-deleted", "tag": "f8cc646b-86d0-47e0-ad8f-969bf944f27a"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:49:22.147274 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-b510ff0c-4ab5-4bc7-be51-9cd27b9f88e0 req-80193b17-7c0a-490a-b4e9-c35ae61c94a7 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:22.147707 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-b510ff0c-4ab5-4bc7-be51-9cd27b9f88e0 req-80193b17-7c0a-490a-b4e9-c35ae61c94a7 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:22.159679 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-b510ff0c-4ab5-4bc7-be51-9cd27b9f88e0 req-80193b17-7c0a-490a-b4e9-c35ae61c94a7 service nova] Creating event network-vif-deleted:f8cc646b-86d0-47e0-ad8f-969bf944f27a for instance 6677127b-9689-4fca-a172-8c1ab49d8146 on hv-cinder-84315 May 24 15:49:22.164756 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-b510ff0c-4ab5-4bc7-be51-9cd27b9f88e0 req-80193b17-7c0a-490a-b4e9-c35ae61c94a7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246202 May 24 15:49:22.165364 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 543/1040] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:49:22.954872 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9a902300-9098-457b-b47d-e2c198fa744d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:22.955488 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-9a902300-9098-457b-b47d-e2c198fa744d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:22.962557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a902300-9098-457b-b47d-e2c198fa744d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:22.962993 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a902300-9098-457b-b47d-e2c198fa744d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:22.963771 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a902300-9098-457b-b47d-e2c198fa744d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:22.964222 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-9a902300-9098-457b-b47d-e2c198fa744d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:22.979173 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-9a902300-9098-457b-b47d-e2c198fa744d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9a902300-9098-457b-b47d-e2c198fa744d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 HTTP/1.1 May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:49:22.981518 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:22.983008 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': '6677127b-9689-4fca-a172-8c1ab49d8146'} May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:49:22.987586 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:22.988980 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:22.990160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-9a902300-9098-457b-b47d-e2c198fa744d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:49:22.990160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-9a902300-9098-457b-b47d-e2c198fa744d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 404 len: 111 microversion: 2.1 time: 0.031992 May 24 15:49:22.990160 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 498/1041] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:49:22 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:49:22.996562 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-d6cd9465-12db-4229-b1a8-88b34f1aee09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '.version_select at 0x7fb1d48e9b80>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:23.017677 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-d6cd9465-12db-4229-b1a8-88b34f1aee09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-287550052" status: 202 len: 0 microversion: 2.1 time: 0.025715 May 24 15:49:23.018254 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 544/1042] 10.222.0.55 () {58 vars in 1217 bytes} [Tue May 24 15:49:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-287550052 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:49:24.755256 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e32bbfd3-be9a-4dfd-aa65-12fe1c738ee4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:24.755783 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e32bbfd3-be9a-4dfd-aa65-12fe1c738ee4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:24.763024 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e32bbfd3-be9a-4dfd-aa65-12fe1c738ee4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:24.763461 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e32bbfd3-be9a-4dfd-aa65-12fe1c738ee4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:24.764251 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e32bbfd3-be9a-4dfd-aa65-12fe1c738ee4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:24.764680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e32bbfd3-be9a-4dfd-aa65-12fe1c738ee4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:24.778471 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-e32bbfd3-be9a-4dfd-aa65-12fe1c738ee4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e32bbfd3-be9a-4dfd-aa65-12fe1c738ee4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: DELETE /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 HTTP/1.1 May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:49:24.780000 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:24.781623 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': '6677127b-9689-4fca-a172-8c1ab49d8146'} May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:49:24.782731 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:24.784063 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:24.785821 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e32bbfd3-be9a-4dfd-aa65-12fe1c738ee4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:49:24.785821 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e32bbfd3-be9a-4dfd-aa65-12fe1c738ee4 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 404 len: 111 microversion: 2.1 time: 0.030059 May 24 15:49:24.785821 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 499/1043] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:49:24 2022] DELETE /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:49:24.790433 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-367e7a87-f516-4ad1-90c2-62bc3e74c099 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:24.791162 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-367e7a87-f516-4ad1-90c2-62bc3e74c099 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: 6677127b-9689-4fca-a172-8c1ab49d8146] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:24.798142 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-367e7a87-f516-4ad1-90c2-62bc3e74c099 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:24.798585 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-367e7a87-f516-4ad1-90c2-62bc3e74c099 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:24.799335 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-367e7a87-f516-4ad1-90c2-62bc3e74c099 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:24.799763 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-367e7a87-f516-4ad1-90c2-62bc3e74c099 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:24.813331 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-367e7a87-f516-4ad1-90c2-62bc3e74c099 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-367e7a87-f516-4ad1-90c2-62bc3e74c099 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 HTTP/1.1 May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:49:24.814938 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:24.816510 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '6677127b-9689-4fca-a172-8c1ab49d8146'} May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:49:24.817623 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. May 24 15:49:24.819155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:24.820900 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-367e7a87-f516-4ad1-90c2-62bc3e74c099 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance 6677127b-9689-4fca-a172-8c1ab49d8146 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:49:24.820900 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-367e7a87-f516-4ad1-90c2-62bc3e74c099 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146" status: 404 len: 111 microversion: 2.1 time: 0.030212 May 24 15:49:24.820900 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 545/1044] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:49:24 2022] GET /compute/v2.1/servers/6677127b-9689-4fca-a172-8c1ab49d8146 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:49:25.964322 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-76d071ff-9c57-450b-bc62-707614b420e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:25.964879 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-76d071ff-9c57-450b-bc62-707614b420e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:25.972065 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-76d071ff-9c57-450b-bc62-707614b420e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:25.972566 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-76d071ff-9c57-450b-bc62-707614b420e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:25.973323 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-76d071ff-9c57-450b-bc62-707614b420e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:25.973753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-76d071ff-9c57-450b-bc62-707614b420e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:25.988677 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-76d071ff-9c57-450b-bc62-707614b420e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-76d071ff-9c57-450b-bc62-707614b420e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: DELETE /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad HTTP/1.1 May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:49:25.990238 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:49:25.991727 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'a71ea75e-0ceb-452a-ae87-90e9793528ad'} May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:49:25.992550 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:49:25.993833 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:25.995391 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-76d071ff-9c57-450b-bc62-707614b420e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:49:25.995391 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-76d071ff-9c57-450b-bc62-707614b420e8 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 404 len: 111 microversion: 2.1 time: 0.031328 May 24 15:49:25.995391 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 500/1045] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:49:25 2022] DELETE /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:49:26.000303 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3f9d4fd8-218c-4287-8b4c-17b62914263d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:26.000912 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3f9d4fd8-218c-4287-8b4c-17b62914263d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: a71ea75e-0ceb-452a-ae87-90e9793528ad] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:26.007790 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3f9d4fd8-218c-4287-8b4c-17b62914263d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:26.008273 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3f9d4fd8-218c-4287-8b4c-17b62914263d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:26.009044 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3f9d4fd8-218c-4287-8b4c-17b62914263d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:26.009472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3f9d4fd8-218c-4287-8b4c-17b62914263d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:26.026225 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-3f9d4fd8-218c-4287-8b4c-17b62914263d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3f9d4fd8-218c-4287-8b4c-17b62914263d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad HTTP/1.1 May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:49:26.027750 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:49:26.029369 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'a71ea75e-0ceb-452a-ae87-90e9793528ad'} May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:49:26.030269 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. May 24 15:49:26.031807 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:26.033303 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3f9d4fd8-218c-4287-8b4c-17b62914263d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance a71ea75e-0ceb-452a-ae87-90e9793528ad could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:49:26.033303 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3f9d4fd8-218c-4287-8b4c-17b62914263d tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad" status: 404 len: 111 microversion: 2.1 time: 0.033057 May 24 15:49:26.033303 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 546/1046] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:49:25 2022] GET /compute/v2.1/servers/a71ea75e-0ceb-452a-ae87-90e9793528ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 15:49:26.038420 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7dcc7edb-5c3f-445f-a8cd-af0ccf48c700 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:26.038929 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7dcc7edb-5c3f-445f-a8cd-af0ccf48c700 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:26.045320 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7dcc7edb-5c3f-445f-a8cd-af0ccf48c700 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:26.045802 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7dcc7edb-5c3f-445f-a8cd-af0ccf48c700 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:26.046555 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7dcc7edb-5c3f-445f-a8cd-af0ccf48c700 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:26.046994 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7dcc7edb-5c3f-445f-a8cd-af0ccf48c700 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:26.060928 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-7dcc7edb-5c3f-445f-a8cd-af0ccf48c700 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7dcc7edb-5c3f-445f-a8cd-af0ccf48c700 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: DELETE /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 HTTP/1.1 May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:49:26.062458 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:49:26.064136 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'efdad178-71c5-4ee8-ae88-eb20542da928'} May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:49:26.064952 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:49:26.066198 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:26.067510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7dcc7edb-5c3f-445f-a8cd-af0ccf48c700 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:49:26.067510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7dcc7edb-5c3f-445f-a8cd-af0ccf48c700 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 404 len: 111 microversion: 2.1 time: 0.029363 May 24 15:49:26.067510 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 501/1047] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:49:26 2022] DELETE /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:49:26.072994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7d5287bb-6183-4940-bbb7-f6bed3796f09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:26.073625 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-7d5287bb-6183-4940-bbb7-f6bed3796f09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: efdad178-71c5-4ee8-ae88-eb20542da928] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:26.079887 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7d5287bb-6183-4940-bbb7-f6bed3796f09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:26.080370 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7d5287bb-6183-4940-bbb7-f6bed3796f09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:26.081116 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7d5287bb-6183-4940-bbb7-f6bed3796f09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:26.081546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-7d5287bb-6183-4940-bbb7-f6bed3796f09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:26.094970 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-7d5287bb-6183-4940-bbb7-f6bed3796f09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7d5287bb-6183-4940-bbb7-f6bed3796f09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 HTTP/1.1 May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:49:26.096514 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:49:26.098104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'efdad178-71c5-4ee8-ae88-eb20542da928'} May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:49:26.099229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. May 24 15:49:26.100775 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:26.102314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-7d5287bb-6183-4940-bbb7-f6bed3796f09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance efdad178-71c5-4ee8-ae88-eb20542da928 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:49:26.102314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-7d5287bb-6183-4940-bbb7-f6bed3796f09 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928" status: 404 len: 111 microversion: 2.1 time: 0.028903 May 24 15:49:26.102314 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 547/1048] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:49:26 2022] GET /compute/v2.1/servers/efdad178-71c5-4ee8-ae88-eb20542da928 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:49:27.260152 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4d837967-7c3a-44f9-88b9-99abb9cece97 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:27.260701 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-4d837967-7c3a-44f9-88b9-99abb9cece97 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:27.267730 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d837967-7c3a-44f9-88b9-99abb9cece97 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:27.268204 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d837967-7c3a-44f9-88b9-99abb9cece97 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:27.268953 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d837967-7c3a-44f9-88b9-99abb9cece97 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:27.269375 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-4d837967-7c3a-44f9-88b9-99abb9cece97 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:27.283120 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.wsgi [None req-4d837967-7c3a-44f9-88b9-99abb9cece97 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4d837967-7c3a-44f9-88b9-99abb9cece97 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: request: DELETE /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d HTTP/1.1 May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept: application/json May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Accept-Encoding: identity May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Connection: close May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Length: 0 May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Content-Type: application/json May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Host: 10.222.0.55 May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Openstack-System-Scope: None May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: User-Agent: python-urllib3/1.26.9 May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Id: None May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Domain-Name: None May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Identity-Status: Confirmed May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Is-Admin-Project: True May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Id: default May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Domain-Name: Default May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Role: reader,member May 24 15:49:27.284699 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Roles: reader,member May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Id: default May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Domain-Name: Default May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: method: > May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: exception: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:49:27.286341 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: action_args: {'id': 'b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d'} May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:49:27.287218 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:49:27.288753 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR nova.api.openstack.wsgi May 24 15:49:27.290190 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-4d837967-7c3a-44f9-88b9-99abb9cece97 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. {{(pid=129339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:49:27.290190 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-4d837967-7c3a-44f9-88b9-99abb9cece97 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 404 len: 111 microversion: 2.1 time: 0.029869 May 24 15:49:27.290190 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 502/1049] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:49:27 2022] DELETE /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:49:27.296818 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2608d11b-e61a-42f5-8e93-9ebddfdbdf13 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:49:27.297433 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2608d11b-e61a-42f5-8e93-9ebddfdbdf13 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] [instance: b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:49:27.307373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2608d11b-e61a-42f5-8e93-9ebddfdbdf13 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:27.307964 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2608d11b-e61a-42f5-8e93-9ebddfdbdf13 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:27.309051 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2608d11b-e61a-42f5-8e93-9ebddfdbdf13 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:49:27.309609 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2608d11b-e61a-42f5-8e93-9ebddfdbdf13 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:49:27.324313 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-2608d11b-e61a-42f5-8e93-9ebddfdbdf13 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] HTTP exception thrown: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2608d11b-e61a-42f5-8e93-9ebddfdbdf13 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Request method failure captured: May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d HTTP/1.1 May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP2PyEJFjwTxlEjWyFe-fZBMBzQPO6x3ZX3ivWwbhvr3gCOluJGWx-MVatBMD1ybN1lq0TbBV0LHNbYb_fhBK0-SsiOOrjQ95InP9LAHYV-r9LJpv3sYkejWns-NWxyfM9RdZaHNel68lpZBoQIIAW7AjRu2lkuvMtIuS0r7zgq1wgY May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:49:27.325829 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/a30edd891b96456fbba6409a815f5fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: a30edd891b96456fbba6409a815f5fd8 May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-768992704 May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 0f8105d1de0d45218576d74a2ba4abe4 May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-AttachVolumeNegativeTest-768992704-project May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:49:27.327731 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': 'b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d'} May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:49:27.328855 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. May 24 15:49:27.330365 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:49:27.331732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2608d11b-e61a-42f5-8e93-9ebddfdbdf13 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] Returning 404 to user: Instance b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:49:27.331732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2608d11b-e61a-42f5-8e93-9ebddfdbdf13 tempest-AttachVolumeNegativeTest-768992704 tempest-AttachVolumeNegativeTest-768992704-project] 10.222.0.55 "GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d" status: 404 len: 111 microversion: 2.1 time: 0.036506 May 24 15:49:27.331732 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 548/1050] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:49:27 2022] GET /compute/v2.1/servers/b55f3a17-fc23-47fb-8bd7-5d1ca5a3ac5d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:49:56.958445 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:49:56.959084 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Tue May 24 15:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:50:44.915460 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=20 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:50:44.916364 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:50:45.093945 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-05b8cdfc-b166-4a94-a37f-0b5a0bb04ddd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Action: 'create', calling method: .version_select at 0x7fb1d53b0af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1019631868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx4bCAFkGoCTWK25F2z3nfBXpu+XXgOc23sLi86jXOf7LkdvT+Nw9Q4IzLA8TUZTcFHJDvev425AObhYFAHEpbOHkpg8Ixa1xNFlwyJYIEXNX43dLWXIyRakBSuyFAhDg=="}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:50:45.109501 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-05b8cdfc-b166-4a94-a37f-0b5a0bb04ddd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Getting quotas for project 6341a9bfc680413892cbfbb3e3845604. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:50:45.113373 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.quota [None req-05b8cdfc-b166-4a94-a37f-0b5a0bb04ddd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Getting quotas for user 55472d5bd87849709ae105e8a49c62db and project 6341a9bfc680413892cbfbb3e3845604. Resources: {'key_pairs'} {{(pid=129339) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:50:45.124993 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR oslo.messaging._drivers.impl_rabbit [None req-05b8cdfc-b166-4a94-a37f-0b5a0bb04ddd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [a0509e2b-f12d-485a-8fdd-3feef6241079] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 15:50:46.137348 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO oslo.messaging._drivers.impl_rabbit [None req-05b8cdfc-b166-4a94-a37f-0b5a0bb04ddd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [a0509e2b-f12d-485a-8fdd-3feef6241079] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 57264. May 24 15:50:46.156889 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-05b8cdfc-b166-4a94-a37f-0b5a0bb04ddd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.243078 May 24 15:50:46.157480 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 503/1051] 10.222.0.55 () {60 vars in 1158 bytes} [Tue May 24 15:50:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:51:02.399280 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:51:02.400019 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:51:02.403975 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1413111082", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1019631868", "security_groups": [{"name": "tempest-secgroup-smoke-359651176"}], "networks": [{"uuid": "158f698e-4d32-4eab-a98a-a86d85437b4e"}], "block_device_mapping_v2": [{"uuid": "8b92b62c-42e7-40e6-ad48-42a718934d34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:51:02.531163 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.network.neutron [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] validate_networks() for [('158f698e-4d32-4eab-a98a-a86d85437b4e', None, None, None, None, None)] {{(pid=129340) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 15:51:02.909154 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Flavor limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 15:51:02.909684 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Image limits 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 15:51:02.910155 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Flavor pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 15:51:02.910558 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Image pref 0:0:0 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 15:51:02.910962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.virt.hardware [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 15:51:02.920193 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:02.920774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:02.921409 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:02.921831 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:02.940159 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Getting quotas for project 6341a9bfc680413892cbfbb3e3845604. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 15:51:02.944225 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.quota [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Getting quotas for user 55472d5bd87849709ae105e8a49c62db and project 6341a9bfc680413892cbfbb3e3845604. Resources: {'instances', 'ram', 'cores'} {{(pid=129340) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 15:51:03.007264 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Going to run 1 instances... {{(pid=129340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 15:51:03.009396 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b92b62c-42e7-40e6-ad48-42a718934d34',volume_size=None,volume_type=None)] {{(pid=129340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 15:51:03.154972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-3c38bb21-d036-4843-9f96-33fb9f52484d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.757518 May 24 15:51:03.155632 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 549/1052] 10.222.0.55 () {60 vars in 1146 bytes} [Tue May 24 15:51:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 15:51:03.163368 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=4 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:51:03.164442 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:51:03.168632 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0fff8f19-d438-4a64-a2f8-14803a4166cc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:03.169229 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0fff8f19-d438-4a64-a2f8-14803a4166cc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:03.228424 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0fff8f19-d438-4a64-a2f8-14803a4166cc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:03.241611 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0fff8f19-d438-4a64-a2f8-14803a4166cc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1089 microversion: 2.1 time: 0.073938 May 24 15:51:03.241611 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 504/1053] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:03 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:04.255472 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a0aaba64-e8cd-4289-a9cd-a8b8914a2d8a tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:04.257195 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a0aaba64-e8cd-4289-a9cd-a8b8914a2d8a tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:04.264301 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0aaba64-e8cd-4289-a9cd-a8b8914a2d8a tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:04.264795 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0aaba64-e8cd-4289-a9cd-a8b8914a2d8a tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:04.265712 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0aaba64-e8cd-4289-a9cd-a8b8914a2d8a tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:04.266126 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a0aaba64-e8cd-4289-a9cd-a8b8914a2d8a tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:04.328567 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a0aaba64-e8cd-4289-a9cd-a8b8914a2d8a tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:04.336563 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a0aaba64-e8cd-4289-a9cd-a8b8914a2d8a tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1205 microversion: 2.1 time: 0.087061 May 24 15:51:04.337141 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 550/1054] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:04 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1205 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:05.355354 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-820464dc-37e7-4a12-bc65-0768a5292980 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:05.356376 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-820464dc-37e7-4a12-bc65-0768a5292980 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:05.364047 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-820464dc-37e7-4a12-bc65-0768a5292980 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:05.364496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-820464dc-37e7-4a12-bc65-0768a5292980 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:05.366189 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-820464dc-37e7-4a12-bc65-0768a5292980 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:05.366632 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-820464dc-37e7-4a12-bc65-0768a5292980 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:05.500742 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-820464dc-37e7-4a12-bc65-0768a5292980 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:05.508602 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-820464dc-37e7-4a12-bc65-0768a5292980 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.157626 May 24 15:51:05.509170 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 505/1055] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:05 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:05.877187 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-555e72f7-255c-454a-97a4-ac7cc84cb7e2 req-7c87218b-635d-4e29-9d32-362fa6fe23eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a1d3011-e2d6-46a1-8a74-37ac8e839da1", "tag": "f4fc067f-b0b2-4c0a-b207-76e106a2f7e0"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:51:05.888020 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-555e72f7-255c-454a-97a4-ac7cc84cb7e2 req-7c87218b-635d-4e29-9d32-362fa6fe23eb service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:05.888501 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-555e72f7-255c-454a-97a4-ac7cc84cb7e2 req-7c87218b-635d-4e29-9d32-362fa6fe23eb service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:05.900693 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-555e72f7-255c-454a-97a4-ac7cc84cb7e2 req-7c87218b-635d-4e29-9d32-362fa6fe23eb service nova] Creating event network-changed:f4fc067f-b0b2-4c0a-b207-76e106a2f7e0 for instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 on hv-cinder-84315 May 24 15:51:05.906388 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-555e72f7-255c-454a-97a4-ac7cc84cb7e2 req-7c87218b-635d-4e29-9d32-362fa6fe23eb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032800 May 24 15:51:05.906914 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 551/1056] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:51:06.530786 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-615714b5-ed85-4a10-9ae0-d8c9e75c894d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:06.531796 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-615714b5-ed85-4a10-9ae0-d8c9e75c894d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:06.542907 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-615714b5-ed85-4a10-9ae0-d8c9e75c894d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:06.543692 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-615714b5-ed85-4a10-9ae0-d8c9e75c894d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:06.544982 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-615714b5-ed85-4a10-9ae0-d8c9e75c894d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:06.545690 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-615714b5-ed85-4a10-9ae0-d8c9e75c894d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:06.685034 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-615714b5-ed85-4a10-9ae0-d8c9e75c894d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:06.693334 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-615714b5-ed85-4a10-9ae0-d8c9e75c894d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.169033 May 24 15:51:06.693908 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 506/1057] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:06 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:07.711341 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2f79484e-76d8-41a5-92fd-d527525d20eb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:07.712062 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2f79484e-76d8-41a5-92fd-d527525d20eb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:07.718806 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f79484e-76d8-41a5-92fd-d527525d20eb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:07.719250 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f79484e-76d8-41a5-92fd-d527525d20eb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:07.719999 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f79484e-76d8-41a5-92fd-d527525d20eb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:07.720457 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2f79484e-76d8-41a5-92fd-d527525d20eb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:07.859394 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2f79484e-76d8-41a5-92fd-d527525d20eb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:07.867296 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2f79484e-76d8-41a5-92fd-d527525d20eb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.160705 May 24 15:51:07.867860 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 552/1058] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:07 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:08.888895 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-cdc9166a-dfba-43b7-afee-5d9e1c3d2748 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:08.890039 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-cdc9166a-dfba-43b7-afee-5d9e1c3d2748 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:08.898156 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cdc9166a-dfba-43b7-afee-5d9e1c3d2748 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:08.898601 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cdc9166a-dfba-43b7-afee-5d9e1c3d2748 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:08.899360 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cdc9166a-dfba-43b7-afee-5d9e1c3d2748 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:08.899786 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-cdc9166a-dfba-43b7-afee-5d9e1c3d2748 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:09.039880 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-cdc9166a-dfba-43b7-afee-5d9e1c3d2748 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:09.051082 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-cdc9166a-dfba-43b7-afee-5d9e1c3d2748 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.168751 May 24 15:51:09.051823 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 507/1059] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:08 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:10.077006 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-92ab9290-1449-4869-8193-387d82515234 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:10.078039 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-92ab9290-1449-4869-8193-387d82515234 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:10.085785 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-92ab9290-1449-4869-8193-387d82515234 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:10.086229 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-92ab9290-1449-4869-8193-387d82515234 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:10.086987 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-92ab9290-1449-4869-8193-387d82515234 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:10.087418 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-92ab9290-1449-4869-8193-387d82515234 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:10.226050 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-92ab9290-1449-4869-8193-387d82515234 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:10.234093 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-92ab9290-1449-4869-8193-387d82515234 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.163645 May 24 15:51:10.234657 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 553/1060] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:10 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:11.251598 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-a5483e31-e7dc-48e5-a134-578a206b09e5 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:11.252294 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-a5483e31-e7dc-48e5-a134-578a206b09e5 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:11.259860 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a5483e31-e7dc-48e5-a134-578a206b09e5 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:11.260327 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a5483e31-e7dc-48e5-a134-578a206b09e5 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:11.261134 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a5483e31-e7dc-48e5-a134-578a206b09e5 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:11.261587 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-a5483e31-e7dc-48e5-a134-578a206b09e5 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:11.394636 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-a5483e31-e7dc-48e5-a134-578a206b09e5 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:11.405743 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-a5483e31-e7dc-48e5-a134-578a206b09e5 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.157894 May 24 15:51:11.406485 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 508/1061] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:11 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:12.425838 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-96d0aad3-d6ed-463b-a742-2d1cc86cb6d4 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:12.426563 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-96d0aad3-d6ed-463b-a742-2d1cc86cb6d4 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:12.433526 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96d0aad3-d6ed-463b-a742-2d1cc86cb6d4 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:12.434022 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96d0aad3-d6ed-463b-a742-2d1cc86cb6d4 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:12.434857 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96d0aad3-d6ed-463b-a742-2d1cc86cb6d4 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:12.435372 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-96d0aad3-d6ed-463b-a742-2d1cc86cb6d4 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:12.579639 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-96d0aad3-d6ed-463b-a742-2d1cc86cb6d4 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:12.588062 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-96d0aad3-d6ed-463b-a742-2d1cc86cb6d4 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.168054 May 24 15:51:12.588676 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 554/1062] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:12 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:13.612084 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-095ff10f-1daa-4ec8-bb43-2e6f9f97402c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:13.612858 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-095ff10f-1daa-4ec8-bb43-2e6f9f97402c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:13.616219 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell0:SELECT=2 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:51:13.623876 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-095ff10f-1daa-4ec8-bb43-2e6f9f97402c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:13.624517 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-095ff10f-1daa-4ec8-bb43-2e6f9f97402c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:13.625544 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-095ff10f-1daa-4ec8-bb43-2e6f9f97402c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:13.626141 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-095ff10f-1daa-4ec8-bb43-2e6f9f97402c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:13.768163 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-095ff10f-1daa-4ec8-bb43-2e6f9f97402c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:13.780689 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-095ff10f-1daa-4ec8-bb43-2e6f9f97402c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.173605 May 24 15:51:13.781520 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 509/1063] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:13 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:14.798111 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-eae7a2fe-f423-4762-858d-db5dc1f4b58c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:14.798701 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-eae7a2fe-f423-4762-858d-db5dc1f4b58c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:14.801085 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=2 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:51:14.801740 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell0:SELECT=6 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:51:14.809491 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eae7a2fe-f423-4762-858d-db5dc1f4b58c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:14.809933 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eae7a2fe-f423-4762-858d-db5dc1f4b58c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:14.810692 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eae7a2fe-f423-4762-858d-db5dc1f4b58c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:14.811118 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-eae7a2fe-f423-4762-858d-db5dc1f4b58c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:14.946897 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-eae7a2fe-f423-4762-858d-db5dc1f4b58c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:14.954362 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-eae7a2fe-f423-4762-858d-db5dc1f4b58c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.160143 May 24 15:51:14.954930 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 555/1064] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:14 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:15.974310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-5e79a108-ffa2-4cbc-8d05-f433449b5366 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:15.974985 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-5e79a108-ffa2-4cbc-8d05-f433449b5366 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:15.983286 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5e79a108-ffa2-4cbc-8d05-f433449b5366 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:15.983797 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5e79a108-ffa2-4cbc-8d05-f433449b5366 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:15.984719 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5e79a108-ffa2-4cbc-8d05-f433449b5366 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:15.985216 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-5e79a108-ffa2-4cbc-8d05-f433449b5366 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:16.131962 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-5e79a108-ffa2-4cbc-8d05-f433449b5366 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:16.139968 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-5e79a108-ffa2-4cbc-8d05-f433449b5366 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.171662 May 24 15:51:16.140568 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 510/1065] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:15 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:16.524826 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-c150bd62-e205-480c-ae2d-c3d0f097b0ac req-b6ce6aba-373f-493c-acad-36f5d82fc968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1d3011-e2d6-46a1-8a74-37ac8e839da1", "name": "network-vif-plugged", "status": "completed", "tag": "f4fc067f-b0b2-4c0a-b207-76e106a2f7e0"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:51:16.532889 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-c150bd62-e205-480c-ae2d-c3d0f097b0ac req-b6ce6aba-373f-493c-acad-36f5d82fc968 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:16.533315 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-c150bd62-e205-480c-ae2d-c3d0f097b0ac req-b6ce6aba-373f-493c-acad-36f5d82fc968 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:16.544275 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-c150bd62-e205-480c-ae2d-c3d0f097b0ac req-b6ce6aba-373f-493c-acad-36f5d82fc968 service nova] Creating event network-vif-plugged:f4fc067f-b0b2-4c0a-b207-76e106a2f7e0 for instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 on hv-cinder-84315 May 24 15:51:16.549199 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-c150bd62-e205-480c-ae2d-c3d0f097b0ac req-b6ce6aba-373f-493c-acad-36f5d82fc968 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111382 May 24 15:51:16.549724 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 556/1066] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:51:17.160223 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b408a3a5-64e3-41d0-b844-dca986008b39 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:17.160847 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b408a3a5-64e3-41d0-b844-dca986008b39 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:17.168306 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b408a3a5-64e3-41d0-b844-dca986008b39 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:17.168789 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b408a3a5-64e3-41d0-b844-dca986008b39 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:17.169626 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b408a3a5-64e3-41d0-b844-dca986008b39 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:17.170105 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b408a3a5-64e3-41d0-b844-dca986008b39 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:17.311901 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b408a3a5-64e3-41d0-b844-dca986008b39 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:17.320159 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b408a3a5-64e3-41d0-b844-dca986008b39 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1260 microversion: 2.1 time: 0.166566 May 24 15:51:17.320738 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 511/1067] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:17 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:18.340382 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-5f6531e7-937c-4f8a-ba6f-f6b9703e8440 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:18.341167 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-5f6531e7-937c-4f8a-ba6f-f6b9703e8440 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:18.349758 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5f6531e7-937c-4f8a-ba6f-f6b9703e8440 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:18.350348 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5f6531e7-937c-4f8a-ba6f-f6b9703e8440 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:18.351389 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5f6531e7-937c-4f8a-ba6f-f6b9703e8440 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:18.351936 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-5f6531e7-937c-4f8a-ba6f-f6b9703e8440 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:18.494811 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-5f6531e7-937c-4f8a-ba6f-f6b9703e8440 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:18.502552 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-5f6531e7-937c-4f8a-ba6f-f6b9703e8440 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1445 microversion: 2.1 time: 0.168953 May 24 15:51:18.503111 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 557/1068] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:18 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:18.519055 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-94d26554-a7e8-4a2f-9455-c0e3dbdb7ec8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:51:18.519624 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-94d26554-a7e8-4a2f-9455-c0e3dbdb7ec8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:51:18.526289 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-94d26554-a7e8-4a2f-9455-c0e3dbdb7ec8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:18.526732 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-94d26554-a7e8-4a2f-9455-c0e3dbdb7ec8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:18.527478 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-94d26554-a7e8-4a2f-9455-c0e3dbdb7ec8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:18.527901 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-94d26554-a7e8-4a2f-9455-c0e3dbdb7ec8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:18.666033 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-94d26554-a7e8-4a2f-9455-c0e3dbdb7ec8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:51:18.678409 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-94d26554-a7e8-4a2f-9455-c0e3dbdb7ec8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1445 microversion: 2.1 time: 0.162914 May 24 15:51:18.679194 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 512/1069] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:51:18 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:51:20.487216 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-e7d351c4-e384-4be6-b8d7-e6aad208a2cd req-2f6c8e88-aef4-469c-a2cd-50c8a403f1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a1d3011-e2d6-46a1-8a74-37ac8e839da1", "tag": "f4fc067f-b0b2-4c0a-b207-76e106a2f7e0"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:51:20.496207 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-e7d351c4-e384-4be6-b8d7-e6aad208a2cd req-2f6c8e88-aef4-469c-a2cd-50c8a403f1f6 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:51:20.496737 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-e7d351c4-e384-4be6-b8d7-e6aad208a2cd req-2f6c8e88-aef4-469c-a2cd-50c8a403f1f6 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:51:20.507967 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-e7d351c4-e384-4be6-b8d7-e6aad208a2cd req-2f6c8e88-aef4-469c-a2cd-50c8a403f1f6 service nova] Creating event network-changed:f4fc067f-b0b2-4c0a-b207-76e106a2f7e0 for instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 on hv-cinder-84315 May 24 15:51:20.513316 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-e7d351c4-e384-4be6-b8d7-e6aad208a2cd req-2f6c8e88-aef4-469c-a2cd-50c8a403f1f6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030097 May 24 15:51:20.514117 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 558/1070] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:51:57.794843 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:51:57.795650 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Tue May 24 15:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:53:08.300880 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:53:08.301882 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Tue May 24 15:53:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:53:13.023226 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9535c9c7-257e-4519-81a0-efdb66d556f8] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 24 15:53:13.024266 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=20 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:53:13.025159 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=48 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:53:13.030283 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7248720b-93d6-45b1-a8f3-6d30783ba436 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:53:13.030942 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7248720b-93d6-45b1-a8f3-6d30783ba436 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:13.039047 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7248720b-93d6-45b1-a8f3-6d30783ba436 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:13.039496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7248720b-93d6-45b1-a8f3-6d30783ba436 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:13.040313 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7248720b-93d6-45b1-a8f3-6d30783ba436 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:13.040748 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7248720b-93d6-45b1-a8f3-6d30783ba436 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:13.063826 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.objects.instance [None req-7248720b-93d6-45b1-a8f3-6d30783ba436 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lazy-loading 'flavor' on Instance uuid 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 {{(pid=129339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 15:53:13.174511 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7248720b-93d6-45b1-a8f3-6d30783ba436 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "POST /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1/action" status: 202 len: 0 microversion: 2.1 time: 0.153598 May 24 15:53:13.175088 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 513/1071] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:53:13 2022] POST /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:53:13.181963 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3195e6e3-6968-49c0-95cc-8357e29a5122] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 15:53:13.182587 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:53:13.183340 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=44 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:53:13.187962 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-acc069fe-9842-40f1-a045-7c4795f7a134 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:13.188800 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-acc069fe-9842-40f1-a045-7c4795f7a134 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:13.197219 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-acc069fe-9842-40f1-a045-7c4795f7a134 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:13.197663 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-acc069fe-9842-40f1-a045-7c4795f7a134 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:13.198480 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-acc069fe-9842-40f1-a045-7c4795f7a134 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:13.198902 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-acc069fe-9842-40f1-a045-7c4795f7a134 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:13.394308 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-acc069fe-9842-40f1-a045-7c4795f7a134 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:13.403232 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-acc069fe-9842-40f1-a045-7c4795f7a134 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.223108 May 24 15:53:13.403799 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 559/1072] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:13 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:14.426491 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-432ac0fc-5786-4e52-8c3f-ce85d0938550 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:14.427641 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-432ac0fc-5786-4e52-8c3f-ce85d0938550 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:14.435437 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-432ac0fc-5786-4e52-8c3f-ce85d0938550 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:14.435878 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-432ac0fc-5786-4e52-8c3f-ce85d0938550 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:14.436680 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-432ac0fc-5786-4e52-8c3f-ce85d0938550 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:14.437107 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-432ac0fc-5786-4e52-8c3f-ce85d0938550 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:14.442452 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO oslo.messaging._drivers.impl_rabbit [-] [9535c9c7-257e-4519-81a0-efdb66d556f8] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 57486. May 24 15:53:14.635657 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-432ac0fc-5786-4e52-8c3f-ce85d0938550 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:14.646816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-432ac0fc-5786-4e52-8c3f-ce85d0938550 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.228509 May 24 15:53:14.647352 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 514/1073] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:14 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:15.669812 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-2467e46e-291e-43c0-9ba6-488b47445bc3 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:15.670416 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-2467e46e-291e-43c0-9ba6-488b47445bc3 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:15.678273 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2467e46e-291e-43c0-9ba6-488b47445bc3 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:15.678708 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2467e46e-291e-43c0-9ba6-488b47445bc3 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:15.679456 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2467e46e-291e-43c0-9ba6-488b47445bc3 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:15.679883 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-2467e46e-291e-43c0-9ba6-488b47445bc3 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:15.696228 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO oslo.messaging._drivers.impl_rabbit [-] [3195e6e3-6968-49c0-95cc-8357e29a5122] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 57492. May 24 15:53:15.819587 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-2467e46e-291e-43c0-9ba6-488b47445bc3 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:15.827261 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-2467e46e-291e-43c0-9ba6-488b47445bc3 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.161377 May 24 15:53:15.827792 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 560/1074] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:15 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:16.844881 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-3be90865-a132-4a5f-b29b-8a1f1c687944 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:16.845497 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-3be90865-a132-4a5f-b29b-8a1f1c687944 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:16.852554 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3be90865-a132-4a5f-b29b-8a1f1c687944 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:16.852991 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3be90865-a132-4a5f-b29b-8a1f1c687944 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:16.853757 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3be90865-a132-4a5f-b29b-8a1f1c687944 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:16.854181 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-3be90865-a132-4a5f-b29b-8a1f1c687944 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:16.968386 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:53:16.968637 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Tue May 24 15:53:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 (ip 10.222.0.55) !!! May 24 15:53:16.990305 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-3be90865-a132-4a5f-b29b-8a1f1c687944 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:16.998099 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-3be90865-a132-4a5f-b29b-8a1f1c687944 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.157123 May 24 15:53:16.998742 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 515/1075] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:16 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:18.019139 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b641c51a-46d4-4cc9-a584-b7b18e9850da tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:18.020130 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b641c51a-46d4-4cc9-a584-b7b18e9850da tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:18.027791 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b641c51a-46d4-4cc9-a584-b7b18e9850da tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:18.028265 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b641c51a-46d4-4cc9-a584-b7b18e9850da tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:18.029014 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b641c51a-46d4-4cc9-a584-b7b18e9850da tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:18.029443 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b641c51a-46d4-4cc9-a584-b7b18e9850da tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:18.169205 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b641c51a-46d4-4cc9-a584-b7b18e9850da tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:18.183511 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b641c51a-46d4-4cc9-a584-b7b18e9850da tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.170803 May 24 15:53:18.184082 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 561/1076] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:18 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:19.205002 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-bfe6a2cb-6e02-48fb-8d0c-fea5fc8a9bcc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:19.206036 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-bfe6a2cb-6e02-48fb-8d0c-fea5fc8a9bcc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:19.217316 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bfe6a2cb-6e02-48fb-8d0c-fea5fc8a9bcc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:19.218050 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bfe6a2cb-6e02-48fb-8d0c-fea5fc8a9bcc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:19.219289 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bfe6a2cb-6e02-48fb-8d0c-fea5fc8a9bcc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:19.219996 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-bfe6a2cb-6e02-48fb-8d0c-fea5fc8a9bcc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:19.365142 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-bfe6a2cb-6e02-48fb-8d0c-fea5fc8a9bcc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:19.372993 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-bfe6a2cb-6e02-48fb-8d0c-fea5fc8a9bcc tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.174437 May 24 15:53:19.373565 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 516/1077] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:19 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:20.393690 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-cacf16da-ee59-4e12-b865-7ae3fda020bb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:20.394573 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-cacf16da-ee59-4e12-b865-7ae3fda020bb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:20.402055 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cacf16da-ee59-4e12-b865-7ae3fda020bb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:20.402496 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cacf16da-ee59-4e12-b865-7ae3fda020bb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:20.403247 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cacf16da-ee59-4e12-b865-7ae3fda020bb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:20.403670 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-cacf16da-ee59-4e12-b865-7ae3fda020bb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:20.546546 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-cacf16da-ee59-4e12-b865-7ae3fda020bb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:20.557878 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-cacf16da-ee59-4e12-b865-7ae3fda020bb tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.169993 May 24 15:53:20.558664 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 562/1078] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:20 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:21.582774 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-6cfa2451-9ffc-4492-bda0-169750863087 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:21.583765 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-6cfa2451-9ffc-4492-bda0-169750863087 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:21.590597 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6cfa2451-9ffc-4492-bda0-169750863087 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:21.591038 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6cfa2451-9ffc-4492-bda0-169750863087 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:21.591787 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6cfa2451-9ffc-4492-bda0-169750863087 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:21.592248 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-6cfa2451-9ffc-4492-bda0-169750863087 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:21.731496 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-6cfa2451-9ffc-4492-bda0-169750863087 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:21.739493 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-6cfa2451-9ffc-4492-bda0-169750863087 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.163334 May 24 15:53:21.740176 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 517/1079] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:21 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:22.758128 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-62688c6c-40ec-4e23-91a6-313209e14bee tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:22.758709 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-62688c6c-40ec-4e23-91a6-313209e14bee tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:22.765763 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-62688c6c-40ec-4e23-91a6-313209e14bee tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:22.766208 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-62688c6c-40ec-4e23-91a6-313209e14bee tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:22.766957 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-62688c6c-40ec-4e23-91a6-313209e14bee tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:22.767383 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-62688c6c-40ec-4e23-91a6-313209e14bee tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:22.904455 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-62688c6c-40ec-4e23-91a6-313209e14bee tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:22.912398 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-62688c6c-40ec-4e23-91a6-313209e14bee tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.158830 May 24 15:53:22.912953 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 563/1080] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:22 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:23.929907 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-41629e97-8232-45f8-a2d6-3ff861ca61ad tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:23.930520 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-41629e97-8232-45f8-a2d6-3ff861ca61ad tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:23.937649 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-41629e97-8232-45f8-a2d6-3ff861ca61ad tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:23.938093 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-41629e97-8232-45f8-a2d6-3ff861ca61ad tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:23.938852 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-41629e97-8232-45f8-a2d6-3ff861ca61ad tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:23.939273 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-41629e97-8232-45f8-a2d6-3ff861ca61ad tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:24.077794 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-41629e97-8232-45f8-a2d6-3ff861ca61ad tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:24.085506 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-41629e97-8232-45f8-a2d6-3ff861ca61ad tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.159686 May 24 15:53:24.086050 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 518/1081] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:23 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:25.110939 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-91922cae-2e1c-4d13-a263-a634f0a7b660 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:25.111888 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-91922cae-2e1c-4d13-a263-a634f0a7b660 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:25.122896 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-91922cae-2e1c-4d13-a263-a634f0a7b660 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:25.123671 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-91922cae-2e1c-4d13-a263-a634f0a7b660 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:25.124988 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-91922cae-2e1c-4d13-a263-a634f0a7b660 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:25.125711 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-91922cae-2e1c-4d13-a263-a634f0a7b660 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:25.264262 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-91922cae-2e1c-4d13-a263-a634f0a7b660 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:25.276734 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-91922cae-2e1c-4d13-a263-a634f0a7b660 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.172084 May 24 15:53:25.277614 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 564/1082] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:25 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:26.301571 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-db18c241-1610-47af-8720-5aff3f75bb28 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:26.302933 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-db18c241-1610-47af-8720-5aff3f75bb28 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:26.310200 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-db18c241-1610-47af-8720-5aff3f75bb28 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:26.310636 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-db18c241-1610-47af-8720-5aff3f75bb28 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:26.311387 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-db18c241-1610-47af-8720-5aff3f75bb28 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:26.311816 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-db18c241-1610-47af-8720-5aff3f75bb28 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:26.446817 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-db18c241-1610-47af-8720-5aff3f75bb28 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:26.455389 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-db18c241-1610-47af-8720-5aff3f75bb28 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1570 microversion: 2.1 time: 0.160319 May 24 15:53:26.456164 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 519/1083] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:26 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:26.471963 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-67791415-2f0b-4ef7-8f9d-322130bb7b83 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:53:26.472582 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-67791415-2f0b-4ef7-8f9d-322130bb7b83 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:26.480277 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-67791415-2f0b-4ef7-8f9d-322130bb7b83 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:26.480730 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-67791415-2f0b-4ef7-8f9d-322130bb7b83 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:26.481488 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-67791415-2f0b-4ef7-8f9d-322130bb7b83 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:26.481917 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-67791415-2f0b-4ef7-8f9d-322130bb7b83 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:26.578415 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-67791415-2f0b-4ef7-8f9d-322130bb7b83 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "POST /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1/action" status: 202 len: 0 microversion: 2.1 time: 0.110209 May 24 15:53:26.579035 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 565/1084] 10.222.0.55 () {60 vars in 1277 bytes} [Tue May 24 15:53:26 2022] POST /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:53:26.587512 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-54e1d8bc-0228-4944-88f0-f1b6f23bf0db tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:26.588237 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-54e1d8bc-0228-4944-88f0-f1b6f23bf0db tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:26.594357 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-54e1d8bc-0228-4944-88f0-f1b6f23bf0db tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:26.594809 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-54e1d8bc-0228-4944-88f0-f1b6f23bf0db tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:26.595740 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-54e1d8bc-0228-4944-88f0-f1b6f23bf0db tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:26.596393 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-54e1d8bc-0228-4944-88f0-f1b6f23bf0db tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:26.767016 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-54e1d8bc-0228-4944-88f0-f1b6f23bf0db tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:26.775213 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-54e1d8bc-0228-4944-88f0-f1b6f23bf0db tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1518 microversion: 2.1 time: 0.191666 May 24 15:53:26.775854 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 520/1085] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:26 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:27.791766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-faa4a675-aeff-4176-a9d3-70ccf74aba90 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:27.792403 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-faa4a675-aeff-4176-a9d3-70ccf74aba90 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:27.799056 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-faa4a675-aeff-4176-a9d3-70ccf74aba90 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:27.799490 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-faa4a675-aeff-4176-a9d3-70ccf74aba90 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:27.800273 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-faa4a675-aeff-4176-a9d3-70ccf74aba90 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:27.801177 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-faa4a675-aeff-4176-a9d3-70ccf74aba90 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:27.941766 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-faa4a675-aeff-4176-a9d3-70ccf74aba90 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:27.949944 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-faa4a675-aeff-4176-a9d3-70ccf74aba90 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1520 microversion: 2.1 time: 0.162069 May 24 15:53:27.950513 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 566/1086] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:27 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:28.937247 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [req-88f3bc6f-77d5-41cb-8b0d-fddf03a40aa6 req-30e35326-803f-45e2-adb8-0e5e1f77da54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1d3011-e2d6-46a1-8a74-37ac8e839da1", "name": "network-vif-unplugged", "status": "completed", "tag": "f4fc067f-b0b2-4c0a-b207-76e106a2f7e0"}]} {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:53:28.946981 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-88f3bc6f-77d5-41cb-8b0d-fddf03a40aa6 req-30e35326-803f-45e2-adb8-0e5e1f77da54 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:28.947416 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [req-88f3bc6f-77d5-41cb-8b0d-fddf03a40aa6 req-30e35326-803f-45e2-adb8-0e5e1f77da54 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:28.961579 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.compute.server_external_events [req-88f3bc6f-77d5-41cb-8b0d-fddf03a40aa6 req-30e35326-803f-45e2-adb8-0e5e1f77da54 service nova] Creating event network-vif-unplugged:f4fc067f-b0b2-4c0a-b207-76e106a2f7e0 for instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 on hv-cinder-84315 May 24 15:53:28.966764 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [req-88f3bc6f-77d5-41cb-8b0d-fddf03a40aa6 req-30e35326-803f-45e2-adb8-0e5e1f77da54 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033133 May 24 15:53:28.967504 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 521/1087] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:53:28.967994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-c568a39c-aff7-42fd-bd85-7b136cd6e16c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:28.968628 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-c568a39c-aff7-42fd-bd85-7b136cd6e16c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:28.975471 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c568a39c-aff7-42fd-bd85-7b136cd6e16c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:28.975912 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c568a39c-aff7-42fd-bd85-7b136cd6e16c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:28.976698 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c568a39c-aff7-42fd-bd85-7b136cd6e16c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:28.977120 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-c568a39c-aff7-42fd-bd85-7b136cd6e16c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:29.109349 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-c568a39c-aff7-42fd-bd85-7b136cd6e16c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:29.117316 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-c568a39c-aff7-42fd-bd85-7b136cd6e16c tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1576 microversion: 2.1 time: 0.153280 May 24 15:53:29.117879 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 567/1088] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:28 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:30.140560 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e4575d2f-1b75-4404-bcc2-9e7c41a57048 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:30.141701 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e4575d2f-1b75-4404-bcc2-9e7c41a57048 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:30.150528 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e4575d2f-1b75-4404-bcc2-9e7c41a57048 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:30.150972 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e4575d2f-1b75-4404-bcc2-9e7c41a57048 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:30.151718 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e4575d2f-1b75-4404-bcc2-9e7c41a57048 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:30.152165 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e4575d2f-1b75-4404-bcc2-9e7c41a57048 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:30.297561 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-e4575d2f-1b75-4404-bcc2-9e7c41a57048 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:30.305577 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e4575d2f-1b75-4404-bcc2-9e7c41a57048 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1576 microversion: 2.1 time: 0.172526 May 24 15:53:30.306147 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 522/1089] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:30 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:31.321994 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-a6a6fce4-a89d-4888-8880-44b3936c6ebd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:31.322574 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-a6a6fce4-a89d-4888-8880-44b3936c6ebd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:31.329450 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a6a6fce4-a89d-4888-8880-44b3936c6ebd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:31.329897 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a6a6fce4-a89d-4888-8880-44b3936c6ebd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:31.330657 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a6a6fce4-a89d-4888-8880-44b3936c6ebd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:31.331112 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-a6a6fce4-a89d-4888-8880-44b3936c6ebd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:31.463658 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-a6a6fce4-a89d-4888-8880-44b3936c6ebd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:31.471411 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-a6a6fce4-a89d-4888-8880-44b3936c6ebd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1576 microversion: 2.1 time: 0.153474 May 24 15:53:31.471976 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 568/1090] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:31 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:32.489881 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-7f3bb333-a302-4414-b03e-f64370d9e0fd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:32.490684 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-7f3bb333-a302-4414-b03e-f64370d9e0fd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:32.501372 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f3bb333-a302-4414-b03e-f64370d9e0fd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:32.502116 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f3bb333-a302-4414-b03e-f64370d9e0fd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:32.503379 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f3bb333-a302-4414-b03e-f64370d9e0fd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:32.504092 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-7f3bb333-a302-4414-b03e-f64370d9e0fd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:32.651736 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-7f3bb333-a302-4414-b03e-f64370d9e0fd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:32.659431 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-7f3bb333-a302-4414-b03e-f64370d9e0fd tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1576 microversion: 2.1 time: 0.173572 May 24 15:53:32.660003 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 523/1091] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:32 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:33.680109 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-ae80f4eb-3070-47cb-a5af-d73f57b66ce7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:33.680708 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-ae80f4eb-3070-47cb-a5af-d73f57b66ce7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:33.687844 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ae80f4eb-3070-47cb-a5af-d73f57b66ce7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:33.688341 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ae80f4eb-3070-47cb-a5af-d73f57b66ce7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:33.689104 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ae80f4eb-3070-47cb-a5af-d73f57b66ce7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:33.689780 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-ae80f4eb-3070-47cb-a5af-d73f57b66ce7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:33.830377 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-ae80f4eb-3070-47cb-a5af-d73f57b66ce7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:33.838376 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-ae80f4eb-3070-47cb-a5af-d73f57b66ce7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1576 microversion: 2.1 time: 0.163860 May 24 15:53:33.838940 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 569/1092] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:33 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:34.856299 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-0c97a23e-e5b7-48fa-889a-2ea49f7945ce tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:34.856885 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-0c97a23e-e5b7-48fa-889a-2ea49f7945ce tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:34.863772 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c97a23e-e5b7-48fa-889a-2ea49f7945ce tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:34.864265 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c97a23e-e5b7-48fa-889a-2ea49f7945ce tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:34.865030 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c97a23e-e5b7-48fa-889a-2ea49f7945ce tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:34.865582 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-0c97a23e-e5b7-48fa-889a-2ea49f7945ce tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:34.997879 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-0c97a23e-e5b7-48fa-889a-2ea49f7945ce tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:35.005829 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-0c97a23e-e5b7-48fa-889a-2ea49f7945ce tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1576 microversion: 2.1 time: 0.153429 May 24 15:53:35.006367 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 524/1093] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:34 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:35.460622 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:53:35.461364 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Tue May 24 15:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:53:36.027856 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-b5e46ca6-b456-42a2-896f-c816fcbad73d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:36.028498 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-b5e46ca6-b456-42a2-896f-c816fcbad73d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:36.037681 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5e46ca6-b456-42a2-896f-c816fcbad73d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:36.038114 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5e46ca6-b456-42a2-896f-c816fcbad73d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:36.039373 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5e46ca6-b456-42a2-896f-c816fcbad73d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:36.039905 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-b5e46ca6-b456-42a2-896f-c816fcbad73d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:36.209227 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-b5e46ca6-b456-42a2-896f-c816fcbad73d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:36.221781 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-b5e46ca6-b456-42a2-896f-c816fcbad73d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1576 microversion: 2.1 time: 0.200566 May 24 15:53:36.222687 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 570/1094] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:36 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:37.240515 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-de7497c8-4bb6-4222-b126-47816ec0fde7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:53:37.241217 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-de7497c8-4bb6-4222-b126-47816ec0fde7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:53:37.248773 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-de7497c8-4bb6-4222-b126-47816ec0fde7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:37.249544 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-de7497c8-4bb6-4222-b126-47816ec0fde7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:37.250671 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-de7497c8-4bb6-4222-b126-47816ec0fde7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:37.251345 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-de7497c8-4bb6-4222-b126-47816ec0fde7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:37.388126 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-de7497c8-4bb6-4222-b126-47816ec0fde7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:53:37.398340 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-de7497c8-4bb6-4222-b126-47816ec0fde7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1563 microversion: 2.1 time: 0.161824 May 24 15:53:37.398936 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 525/1095] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:53:37 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:53:39.055233 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-4b1727b6-b40f-4d1f-8375-12e8587d6f02 req-912f43f1-2af0-423b-9c22-aa6ba232b02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1d3011-e2d6-46a1-8a74-37ac8e839da1", "name": "network-vif-plugged", "status": "completed", "tag": "f4fc067f-b0b2-4c0a-b207-76e106a2f7e0"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:53:39.064798 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-4b1727b6-b40f-4d1f-8375-12e8587d6f02 req-912f43f1-2af0-423b-9c22-aa6ba232b02f service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:53:39.065285 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-4b1727b6-b40f-4d1f-8375-12e8587d6f02 req-912f43f1-2af0-423b-9c22-aa6ba232b02f service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:53:39.078860 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-4b1727b6-b40f-4d1f-8375-12e8587d6f02 req-912f43f1-2af0-423b-9c22-aa6ba232b02f service nova] Creating event network-vif-plugged:f4fc067f-b0b2-4c0a-b207-76e106a2f7e0 for instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 on hv-cinder-84315 May 24 15:53:39.085208 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-4b1727b6-b40f-4d1f-8375-12e8587d6f02 req-912f43f1-2af0-423b-9c22-aa6ba232b02f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033751 May 24 15:53:39.086117 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 571/1096] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 15:54:48.473140 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_api:SELECT=26 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:54:48.474303 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG dbcounter [-] [129339] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:54:48.475972 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_api:SELECT=28 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:54:48.476890 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG dbcounter [-] [129340] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 15:54:48.478903 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-e8aba114-a681-4b6e-a572-ff30a4349744 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:54:48.479452 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e8aba114-a681-4b6e-a572-ff30a4349744 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:54:48.488883 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e8aba114-a681-4b6e-a572-ff30a4349744 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:48.489477 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e8aba114-a681-4b6e-a572-ff30a4349744 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:48.490260 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e8aba114-a681-4b6e-a572-ff30a4349744 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:48.490711 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-e8aba114-a681-4b6e-a572-ff30a4349744 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:48.518157 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-e8aba114-a681-4b6e-a572-ff30a4349744 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Going to try to terminate instance {{(pid=129339) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 15:54:48.546252 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-a0a230a5-c2ae-407b-8a1c-a7fd03c60309 req-6136a8e9-6b20-4e7d-8f69-61f5868df038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a1d3011-e2d6-46a1-8a74-37ac8e839da1", "tag": "f4fc067f-b0b2-4c0a-b207-76e106a2f7e0"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:54:48.554774 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-a0a230a5-c2ae-407b-8a1c-a7fd03c60309 req-6136a8e9-6b20-4e7d-8f69-61f5868df038 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:48.555305 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-a0a230a5-c2ae-407b-8a1c-a7fd03c60309 req-6136a8e9-6b20-4e7d-8f69-61f5868df038 service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:48.566985 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-a0a230a5-c2ae-407b-8a1c-a7fd03c60309 req-6136a8e9-6b20-4e7d-8f69-61f5868df038 service nova] Creating event network-changed:f4fc067f-b0b2-4c0a-b207-76e106a2f7e0 for instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 on hv-cinder-84315 May 24 15:54:48.572305 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-a0a230a5-c2ae-407b-8a1c-a7fd03c60309 req-6136a8e9-6b20-4e7d-8f69-61f5868df038 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098669 May 24 15:54:48.572901 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 572/1097] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:54:48.601919 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-e8aba114-a681-4b6e-a572-ff30a4349744 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 204 len: 0 microversion: 2.1 time: 0.130805 May 24 15:54:48.602577 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 526/1098] 10.222.0.55 () {58 vars in 1238 bytes} [Tue May 24 15:54:48 2022] DELETE /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 15:54:48.617780 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-08c5d7dc-92e7-4664-a7f6-34c598c28985 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:54:48.618607 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-08c5d7dc-92e7-4664-a7f6-34c598c28985 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:54:48.632447 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-08c5d7dc-92e7-4664-a7f6-34c598c28985 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:48.633189 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-08c5d7dc-92e7-4664-a7f6-34c598c28985 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:48.634554 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-08c5d7dc-92e7-4664-a7f6-34c598c28985 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:48.635076 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-08c5d7dc-92e7-4664-a7f6-34c598c28985 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:48.775052 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.policy [None req-08c5d7dc-92e7-4664-a7f6-34c598c28985 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129340) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:54:48.783232 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-08c5d7dc-92e7-4664-a7f6-34c598c28985 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.175702 May 24 15:54:48.783776 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 573/1099] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:54:48 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:54:49.802082 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-b1ac62c5-9840-428e-baac-94988dd53c2d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:54:49.802796 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-b1ac62c5-9840-428e-baac-94988dd53c2d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:54:49.809556 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b1ac62c5-9840-428e-baac-94988dd53c2d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:49.809999 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b1ac62c5-9840-428e-baac-94988dd53c2d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:49.810766 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b1ac62c5-9840-428e-baac-94988dd53c2d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:49.811195 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-b1ac62c5-9840-428e-baac-94988dd53c2d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:49.945472 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-b1ac62c5-9840-428e-baac-94988dd53c2d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:54:49.953372 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-b1ac62c5-9840-428e-baac-94988dd53c2d tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1569 microversion: 2.1 time: 0.155785 May 24 15:54:49.953957 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 527/1100] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:54:49 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:54:50.830406 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [req-00d64f20-565a-4a5d-aa02-865d7d58b529 req-617cf51b-453f-4521-9c9c-01e1d3013d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1d3011-e2d6-46a1-8a74-37ac8e839da1", "name": "network-vif-deleted", "tag": "f4fc067f-b0b2-4c0a-b207-76e106a2f7e0"}]} {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 15:54:50.838954 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-00d64f20-565a-4a5d-aa02-865d7d58b529 req-617cf51b-453f-4521-9c9c-01e1d3013d6a service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:50.839125 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [req-00d64f20-565a-4a5d-aa02-865d7d58b529 req-617cf51b-453f-4521-9c9c-01e1d3013d6a service nova] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:50.850685 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.compute.server_external_events [req-00d64f20-565a-4a5d-aa02-865d7d58b529 req-617cf51b-453f-4521-9c9c-01e1d3013d6a service nova] Creating event network-vif-deleted:f4fc067f-b0b2-4c0a-b207-76e106a2f7e0 for instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 on hv-cinder-84315 May 24 15:54:50.856058 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [req-00d64f20-565a-4a5d-aa02-865d7d58b529 req-617cf51b-453f-4521-9c9c-01e1d3013d6a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086156 May 24 15:54:50.856629 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 574/1101] 10.222.0.55 () {64 vars in 1317 bytes} [Tue May 24 15:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 15:54:50.971312 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-57946149-fe97-484a-947b-666aad907824 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:54:50.971874 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.compute.api [None req-57946149-fe97-484a-947b-666aad907824 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129339) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:54:50.979164 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-57946149-fe97-484a-947b-666aad907824 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:50.979822 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-57946149-fe97-484a-947b-666aad907824 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:50.980856 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-57946149-fe97-484a-947b-666aad907824 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:50.981275 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG oslo_concurrency.lockutils [None req-57946149-fe97-484a-947b-666aad907824 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:51.055634 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.policy [None req-57946149-fe97-484a-947b-666aad907824 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55472d5bd87849709ae105e8a49c62db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6341a9bfc680413892cbfbb3e3845604', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129339) authorize /opt/stack/nova/nova/policy.py:199}} May 24 15:54:51.063822 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-57946149-fe97-484a-947b-666aad907824 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 200 len: 1220 microversion: 2.1 time: 0.096404 May 24 15:54:51.073557 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 528/1102] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:54:50 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 15:54:52.087410 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0df98364-dc22-46e6-b9ea-0d7f683af6e7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '>' {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:54:52.088627 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.compute.api [None req-0df98364-dc22-46e6-b9ea-0d7f683af6e7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [instance: 9a1d3011-e2d6-46a1-8a74-37ac8e839da1] Fetching instance by UUID {{(pid=129340) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 15:54:52.099804 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0df98364-dc22-46e6-b9ea-0d7f683af6e7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:52.100603 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0df98364-dc22-46e6-b9ea-0d7f683af6e7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:52.101872 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0df98364-dc22-46e6-b9ea-0d7f683af6e7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 15:54:52.102582 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG oslo_concurrency.lockutils [None req-0df98364-dc22-46e6-b9ea-0d7f683af6e7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Lock "524ab7f1-ba78-4fd5-b69d-b9e525298061" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 15:54:52.117466 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.wsgi [None req-0df98364-dc22-46e6-b9ea-0d7f683af6e7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] HTTP exception thrown: Instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 could not be found. May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0df98364-dc22-46e6-b9ea-0d7f683af6e7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Request method failure captured: May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: request: GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 HTTP/1.1 May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept: application/json May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Accept-Encoding: identity May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Connection: close May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Length: 0 May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Content-Type: application/json May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Host: 10.222.0.55 May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Openstack-System-Scope: None May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: User-Agent: python-urllib3/1.26.9 May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Auth-Token: gAAAAABijP7Pxbe5QaQpDMe3fNtmTCXlPtZKtFXarnO3nJ54kTN_zpwZsWjyXFY5vGCOAW3jrG7xxP0Q_aX2Ta7JEOaU68dmATumrAn_5xsC9QVp3WWI247amfAnOr-SfQp1SqJwKj3s9R3a65YsVJGK7EOcQe5wWlJKD-6OTK4irPn2EZgQdd8 May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Id: None May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Domain-Name: None May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Identity-Status: Confirmed May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Is-Admin-Project: True May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Id: default May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Domain-Name: Default May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Id: 6341a9bfc680413892cbfbb3e3845604 May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Project-Name: tempest-TestShelveInstance-1201511104 May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Role: reader,member May 24 15:54:52.119084 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Roles: reader,member May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6341a9bfc680413892cbfbb3e3845604"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6341a9bfc680413892cbfbb3e3845604"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6341a9bfc680413892cbfbb3e3845604"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6341a9bfc680413892cbfbb3e3845604"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant: tempest-TestShelveInstance-1201511104 May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Id: 6341a9bfc680413892cbfbb3e3845604 May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-Tenant-Name: tempest-TestShelveInstance-1201511104 May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User: tempest-TestShelveInstance-1201511104-project May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Id: default May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Domain-Name: Default May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Id: 55472d5bd87849709ae105e8a49c62db May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: X-User-Name: tempest-TestShelveInstance-1201511104-project May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: method: > May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: exception: Instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 could not be found. May 24 15:54:52.120819 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: action_args: {'id': '9a1d3011-e2d6-46a1-8a74-37ac8e839da1'} May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: {{(pid=129340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 could not be found. May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 15:54:52.121746 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 could not be found. May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 could not be found. May 24 15:54:52.123270 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: ERROR nova.api.openstack.wsgi May 24 15:54:52.124563 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: DEBUG nova.api.openstack.wsgi [None req-0df98364-dc22-46e6-b9ea-0d7f683af6e7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Returning 404 to user: Instance 9a1d3011-e2d6-46a1-8a74-37ac8e839da1 could not be found. {{(pid=129340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 15:54:52.124563 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO nova.api.openstack.requestlog [None req-0df98364-dc22-46e6-b9ea-0d7f683af6e7 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1" status: 404 len: 111 microversion: 2.1 time: 0.041635 May 24 15:54:52.124563 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: [pid: 129340|app: 0|req: 575/1103] 10.222.0.55 () {58 vars in 1235 bytes} [Tue May 24 15:54:52 2022] GET /compute/v2.1/servers/9a1d3011-e2d6-46a1-8a74-37ac8e839da1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 15:54:52.286310 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: DEBUG nova.api.openstack.wsgi [None req-2b303d8a-6a92-4804-9796-21e0a10ee6c8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] Calling method '.version_select at 0x7fb1d45e0310>' {{(pid=129339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 15:54:52.289624 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2b303d8a-6a92-4804-9796-21e0a10ee6c8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [a0509e2b-f12d-485a-8fdd-3feef6241079] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 15:54:53.302114 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO oslo.messaging._drivers.impl_rabbit [None req-2b303d8a-6a92-4804-9796-21e0a10ee6c8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] [a0509e2b-f12d-485a-8fdd-3feef6241079] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 57620. May 24 15:54:53.326756 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO nova.api.openstack.requestlog [None req-2b303d8a-6a92-4804-9796-21e0a10ee6c8 tempest-TestShelveInstance-1201511104 tempest-TestShelveInstance-1201511104-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1019631868" status: 202 len: 0 microversion: 2.1 time: 1.044284 May 24 15:54:53.327913 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: [pid: 129339|app: 0|req: 529/1104] 10.222.0.55 () {58 vars in 1253 bytes} [Tue May 24 15:54:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1019631868 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 15:54:54.467066 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:54:54.467527 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Tue May 24 15:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:56:28.311415 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:56:28.312252 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Tue May 24 15:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:56:36.979829 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:56:36.980810 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Tue May 24 15:56:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:56:57.809687 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:56:57.810939 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Tue May 24 15:56:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:58:14.477538 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:58:14.478607 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Tue May 24 15:58:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:59:48.324442 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:59:48.325657 dv-cinder-843153-1-iscsi devstack@n-api.service[129340]: Tue May 24 15:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 15:59:56.994275 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 15:59:56.994777 dv-cinder-843153-1-iscsi devstack@n-api.service[129339]: Tue May 24 15:59:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!